Jul 03 23:42:21 devstack cinder-volume[75441]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 23:42:21 devstack cinder-volume[75441]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 23:42:21 devstack cinder-volume[75441]: we strongly recommend against using it for new projects.
Jul 03 23:42:21 devstack cinder-volume[75441]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 23:42:21 devstack cinder-volume[75441]: framework.  For more detail see
Jul 03 23:42:21 devstack cinder-volume[75441]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 23:42:21 devstack cinder-volume[75441]:   import eventlet  # noqa
Jul 03 23:42:24 devstack cinder-volume[75441]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:42:24 devstack cinder-volume[75441]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:42:24 devstack cinder-volume[75441]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:42:25 devstack cinder-volume[75441]: INFO dbcounter [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Registered counter for database cinder
Jul 03 23:42:25 devstack cinder-volume[75441]: DEBUG oslo_db.sqlalchemy.engines [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:42:25 devstack cinder-volume[75441]: DEBUG dbcounter [-] [75441] Writer thread running {{(pid=75441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 23:42:25 devstack cinder-volume[75441]: INFO cinder.rpc [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 23:42:25 devstack cinder-volume[75441]: INFO cinder.rpc [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 23:42:25 devstack cinder-volume[75441]: DEBUG oslo_db.sqlalchemy.engines [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:42:25 devstack cinder-volume[75441]: INFO cinder.volume.manager [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Determined volume DB was empty at startup.
Jul 03 23:42:25 devstack cinder-volume[75441]: DEBUG cinder.volume.manager [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75441) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 03 23:42:25 devstack cinder-volume[75441]: INFO cinder.volume.manager [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 03 23:42:25 devstack cinder-volume[75441]: WARNING stevedore.named [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 23:42:25 devstack cinder-volume[75441]: WARNING castellan.key_manager [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:42:25 devstack cinder-volume[75441]: WARNING cinder.keymgr.conf_key_mgr [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:42:25 devstack cinder-volume[75441]: DEBUG cinder.volume.drivers.lvm [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75441) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 03 23:42:25 devstack cinder-volume[75441]: DEBUG oslo_concurrency.processutils [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_concurrency.processutils [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] CMD "cinder-rtstool verify" returned: 0 in 0.465s {{(pid=75441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_db.sqlalchemy.engines [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:42:26 devstack cinder-volume[75441]: INFO cinder.rpc [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 03 23:42:26 devstack cinder-volume[75441]: INFO cinder.rpc [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 03 23:42:26 devstack cinder-volume[75441]: WARNING stevedore.named [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 23:42:26 devstack cinder-volume[75441]: WARNING castellan.key_manager [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:42:26 devstack cinder-volume[75441]: INFO cinder.volume.manager [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_db.sqlalchemy.engines [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:42:26 devstack cinder-volume[75441]: INFO oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Starting 1 workers
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Started child 75621 {{(pid=75441) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Full set of CONF: {{(pid=75441) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] ******************************************************************************** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Configuration options gathered from: {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] ================================================================================ {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] allow_availability_zone_fallback = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] allow_compression_on_image_upload = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] allowed_direct_url_schemes     = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] api_rate_limit                 = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] auth_strategy                  = keystone {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] az_cache_duration              = 3600 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_availability_zone      = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_host                   = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_name                   = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_stats_polling_interval = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backup_api_class               = cinder.backup.api.API {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75621]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backup_name_template           = backup-%s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backup_use_same_host           = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backup_use_temp_snapshot       = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] chap_password                  = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] chap_username                  =  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cinder_internal_tenant_project_id = c326a393311240bc90ca15745c928477 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cinder_internal_tenant_user_id = efc58a4073384bcf8551752a40f0271f {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cloned_volume_same_az          = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cluster                        = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] compression_format             = gzip {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] compute_api_class              = cinder.compute.nova.API {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] config_dir                     = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] config_source                  = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] control_exchange               = openstack {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] debug                          = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] default_availability_zone      = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] default_group_type             = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] default_volume_type            = lvmdriver-1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] disk_geometry                  = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] driver_client_cert             = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] driver_client_cert_key         = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] driver_data_namespace          = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] driver_ssl_cert_path           = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] driver_ssl_cert_verify         = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] driver_use_ssl                 = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] enable_force_upload            = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] enable_new_services            = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] enable_unsupported_driver      = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] enforce_multipath_for_image_xfer = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] filter_function                = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance_api_insecure            = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack sudo[75625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance_api_servers             = ['http://192.168.122.251/image'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance_api_ssl_compression     = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance_ca_certificates_file    = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance_catalog_info            = image:glance:publicURL {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance_certfile                = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack sudo[75625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance_keyfile                 = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance_num_retries             = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance_request_timeout         = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] goodness_function              = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] graceful_shutdown_timeout      = 5 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] group_api_class                = cinder.group.api.API {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] host                           = devstack {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] image_compress_on_upload       = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] image_conversion_address_space_limit = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] image_conversion_cpu_limit     = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] image_conversion_disable       = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] image_upload_use_cinder_backend = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] image_upload_use_internal_tenant = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] image_volume_cache_enabled     = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] image_volume_cache_max_count   = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] image_volume_cache_max_size_gb = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] init_host_max_objects_retrieval = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] instance_format                = [instance: %(uuid)s]  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] iscsi_target_flags             =  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] iscsi_write_cache              = on {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] iser_helper                    = tgtadm {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] iser_ip_address                = 192.168.122.251 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] iser_port                      = 3260 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] log_color                      = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] log_config_append              = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] log_dir                        = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] log_file                       = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] log_options                    = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] log_rotate_interval            = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] log_rotate_interval_type       = days {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] log_rotation_type              = none {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] max_age                        = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] max_logfile_count              = 30 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] max_logfile_size_mb            = 200 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] max_over_subscription_ratio    = 20.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] message_reap_interval          = 86400 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] message_ttl                    = 2592000 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] migration_create_volume_timeout_secs = 300 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] monkey_patch                   = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] monkey_patch_modules           = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] my_ip                          = 192.168.122.251 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] no_snapshot_gb_quota           = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] num_iser_scan_tries            = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] num_shell_tries                = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] num_volume_device_scan_tries   = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] nvmeof_conn_info_version       = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] nvmet_ns_id                    = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] nvmet_port_id                  = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] osapi_max_limit                = 1000 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] osapi_volume_ext_list          = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] osapi_volume_listen_port       = 8776 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] osapi_volume_use_ssl           = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] osapi_volume_workers           = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] per_volume_size_limit          = -1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] periodic_fuzzy_delay           = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] periodic_interval              = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] public_endpoint                = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] publish_errors                 = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] quota_backup_gigabytes         = 1000 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] quota_backups                  = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] quota_gigabytes                = 1000 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] quota_groups                   = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] quota_snapshots                = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] quota_volumes                  = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] rate_limit_burst               = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] rate_limit_except_level        = CRITICAL {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] rate_limit_interval            = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] reinit_driver_count            = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] replication_device             = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] report_discard_supported       = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] report_interval                = 120 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] reservation_clean_interval     = 86400 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] reservation_expire             = 86400 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] reserved_image_namespaces      = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] reserved_percentage            = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] rpc_response_timeout           = 120 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] run_external_periodic_tasks    = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] scst_target_driver             = iscsi {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] scst_target_iqn_name           = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] service_down_time              = 720 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] shell_completion               = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] snapshot_name_template         = snapshot-%s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] snapshot_same_host             = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] split_loggers                  = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] state_path                     = /opt/stack/data/cinder {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] storage_availability_zone      = nova {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] storage_protocol               = iSCSI {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] syslog_log_facility            = LOG_USER {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] target_helper                  = lioadm {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] target_ip_address              = 192.168.122.251 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] target_port                    = 3260 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] target_protocol                = iscsi {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] target_secondary_ip_addresses  = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] trace_flags                    = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] transport_url                  = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] until_refresh                  = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75621]: INFO cinder.volume.manager [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] use_chap_auth                  = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] use_default_quota_class        = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] use_journal                    = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] use_json                       = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] use_multipath_for_image_xfer   = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] use_stderr                     = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] use_syslog                     = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] verify_glance_signatures       = enabled {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volume_api_class               = cinder.volume.api.API {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volume_backend_name            = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volume_clear                   = zero {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volume_clear_ionice            = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volume_clear_size              = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volume_copy_bps_limit          = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volume_dd_blocksize            = 1M {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volume_name_template           = volume-%s {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volume_service_inithost_offload = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volume_usage_audit_period      = month {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] zoning_mode                    = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_concurrency.disable_process_locking = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.auth_section = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.auth_type   = password {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.auth_version = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.cache       = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:26 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.certfile    = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.delay_auth_decision = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.http_connect_timeout = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.include_service_catalog = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.insecure    = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.interface   = public {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.keyfile     = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_password =  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcache_username =  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.region_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.service_token_roles_required = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.service_type = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.token_cache_time = 300 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.backend                  = dogpile.cache.null {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.backend_argument         = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.backend_expiration_time  = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.config_prefix            = cache.oslo {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.debug_cache_backend      = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.enable_retry_client      = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.enable_socket_keepalive  = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.enabled                  = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.expiration_time          = 600 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.hashclient_retry_attempts = 2 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.memcache_dead_retry      = 300 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.memcache_pool_maxsize    = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.memcache_sasl_enabled    = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.password                 = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.proxies                  = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.redis_db                 = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.redis_sentinel_service_name = mymaster {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.redis_server             = localhost:6379 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.retry_attempts           = 2 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.retry_delay              = 0.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.socket_keepalive_count   = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.socket_keepalive_idle    = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.socket_keepalive_interval = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.socket_timeout           = 1.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.tls_allowed_ciphers      = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.tls_cafile               = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.tls_certfile             = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.tls_enabled              = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.tls_keyfile              = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cache.username                 = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] coordination.backend_url       = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.asyncio_connection    = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.asyncio_slave_connection = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.backend               = sqlalchemy {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.connection            = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.connection_debug      = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.connection_parameters =  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.connection_recycle_time = 3600 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.connection_trace      = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.db_inc_retry_interval = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.db_max_retries        = 20 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.db_max_retry_interval = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.db_retry_interval     = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.max_overflow          = 50 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.max_pool_size         = 5 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.max_retries           = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.mysql_wsrep_sync_wait = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.pool_timeout          = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.retry_interval        = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.slave_connection      = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.sqlite_synchronous    = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.synchronous_reader    = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] database.use_db_reconnect      = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler.connection_string     = messaging:// {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler.enabled               = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler.es_doc_type           = notification {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler.es_scroll_size        = 10000 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler.es_scroll_time        = 2m {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler.filter_error_trace    = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler.hmac_keys             = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler.sentinel_service_name = mymaster {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler.socket_timeout        = 0.1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler.trace_requests        = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler.trace_sqlalchemy      = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler_jaeger.process_tags   = {} {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler_jaeger.service_name_prefix = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] profiler_otlp.service_name_prefix = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_policy.enforce_new_defaults = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_policy.enforce_scope      = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_policy.policy_default_rule = default {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_policy.policy_file        = policy.yaml {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] privsep_osbrick.group          = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] privsep_osbrick.helper_command = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] privsep_osbrick.user           = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cinder_sys_admin.group         = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cinder_sys_admin.helper_command = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] cinder_sys_admin.user          = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] service_user.auth_section      = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] service_user.auth_type         = password {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] service_user.cafile            = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] service_user.certfile          = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] service_user.collect_timing    = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] service_user.insecure          = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] service_user.keyfile           = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] service_user.send_service_user_token = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] service_user.split_loggers     = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] service_user.timeout           = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance.auth_section            = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance.auth_type               = password {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance.certfile                = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance.collect_timing          = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance.insecure                = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance.keyfile                 = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance.region_name             = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance.split_loggers           = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] glance.timeout                 = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.backend_availability_zone = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.chap_password = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.chap_username =  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.disk_geometry = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.driver_client_cert = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.driver_client_cert_key = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.driver_data_namespace = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.driver_use_ssl = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.enable_unsupported_driver = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.extra_capabilities = {} {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.filter_function = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.goodness_function = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.iscsi_target_flags =  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.iscsi_write_cache = on {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.iser_helper   = tgtadm {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.iser_port     = 3260 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.lvm_share_target = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.lvm_type      = auto {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.num_shell_tries = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.nvmet_port_id = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.replication_device = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.report_discard_supported = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.reserved_percentage = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.scst_target_driver = iscsi {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.scst_target_iqn_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.storage_protocol = iSCSI {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.target_helper = tgtadm {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.target_port   = 3260 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.target_protocol = iscsi {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.trace_flags   = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.unique_fqdn_network = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.use_chap_auth = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.volume_backend_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.volume_clear  = zero {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.volume_clear_ionice = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.volume_clear_size = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_reports.file_event_handler = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_reports.log_dir           = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.backend_availability_zone = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.backend_host       = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.chap_password      = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.chap_username      = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.disk_geometry      = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.driver_client_cert = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.driver_data_namespace = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.extra_capabilities = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.filter_function    = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.goodness_function  = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.iser_helper        = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.iser_ip_address    = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.iser_port          = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.iser_target_prefix = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.lvm_share_target   = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.lvm_type           = auto {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.num_shell_tries    = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.replication_device = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.report_discard_supported = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.reserved_percentage = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.scst_target_driver = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.storage_protocol   = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.target_helper      = lioadm {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.target_ip_address  = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.target_port        = 3260 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.trace_flags        = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.use_chap_auth      = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.volume_clear       = zero {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.volume_clear_size  = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] lvmdriver-1.volumes_dir        = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.ssl      = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_notifications.driver = [] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_notifications.retry = -1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] oslo_messaging_notifications.transport_url = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] key_manager.fixed_key          = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.barbican_api_version  = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.barbican_endpoint     = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.barbican_endpoint_type = public {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.barbican_region_name  = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.cafile                = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.certfile              = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.collect_timing        = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.insecure              = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.keyfile               = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.number_of_retries     = 60 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.retry_delay           = 1 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.send_service_user_token = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.split_loggers         = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.timeout               = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.verify_ssl            = True {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican.verify_ssl_path       = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican_service_user.auth_section = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican_service_user.auth_type = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican_service_user.cafile   = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican_service_user.certfile = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican_service_user.collect_timing = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican_service_user.insecure = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican_service_user.keyfile  = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican_service_user.split_loggers = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] barbican_service_user.timeout  = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] vault.approle_role_id          = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] vault.approle_secret_id        = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] vault.kv_mountpoint            = secret {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] vault.kv_path                  = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] vault.kv_version               = 2 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] vault.namespace                = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] vault.root_token_id            = **** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] vault.ssl_ca_crt_file          = None {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] vault.timeout                  = 60.0 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] vault.use_ssl                  = False {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:42:27 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] ******************************************************************************** {{(pid=75441) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 23:42:27 devstack sudo[75625]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.726s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:27 devstack sudo[75750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:42:27 devstack sudo[75750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:27 devstack sudo[75750]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.658s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:28 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:42:28 devstack cinder-volume[75621]: INFO cinder.brick.local_dev.lvm [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 03 23:42:28 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:28 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:28 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:28 devstack sudo[75969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:42:28 devstack sudo[75969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:28 devstack sudo[75969]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:28 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:28 devstack cinder-volume[75621]: DEBUG cinder.brick.local_dev.lvm [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75621) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 03 23:42:28 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:28 devstack sudo[76190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:42:28 devstack sudo[76190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:29 devstack sudo[76190]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.214s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:29 devstack sudo[76399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:42:29 devstack sudo[76399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:30 devstack sudo[76399]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:30 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.796s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:30 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:30 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:30 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:30 devstack sudo[76405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 03 23:42:30 devstack sudo[76405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:31 devstack sudo[76405]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:31 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.729s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:31 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:31 devstack sudo[76409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:42:31 devstack sudo[76409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:32 devstack sudo[76409]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:32 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.789s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:32 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:32 devstack sudo[76421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:42:32 devstack sudo[76421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:33 devstack sudo[76421]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:33 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.953s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:33 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:33 devstack sudo[76427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:42:33 devstack sudo[76427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:34 devstack sudo[76427]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:34 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.950s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:34 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:34 devstack sudo[76432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:42:34 devstack sudo[76432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:34 devstack sudo[76432]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:34 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.713s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:34 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:34 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:34 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:34 devstack sudo[76440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:42:34 devstack sudo[76440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:35 devstack sudo[76440]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:35 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.942s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:35 devstack cinder-volume[75621]: INFO cinder.volume.drivers.lvm [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 03 23:42:35 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:35 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:35 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:35 devstack sudo[76563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:42:35 devstack sudo[76563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:36 devstack cinder-volume[75441]: DEBUG dbcounter [-] [75441] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:42:36 devstack sudo[76563]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:36 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.768s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:36 devstack cinder-volume[75621]: DEBUG cinder.volume.drivers.lvm [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Updating volume stats {{(pid=75621) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 23:42:36 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:36 devstack sudo[76705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:42:36 devstack sudo[76705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:37 devstack sudo[76705]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:37 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.737s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:37 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:37 devstack sudo[76708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:42:37 devstack sudo[76708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:38 devstack sudo[76708]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:38 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:38 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:38 devstack sudo[76711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:42:38 devstack sudo[76711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:38 devstack sudo[76711]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:38 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.666s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:38 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:38 devstack sudo[76715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:42:38 devstack sudo[76715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:39 devstack sudo[76715]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:39 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:39 devstack cinder-volume[75621]: INFO cinder.volume.driver [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 23:42:39 devstack cinder-volume[75621]: DEBUG cinder.volume.driver [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75621) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 03 23:42:39 devstack cinder-volume[75621]: DEBUG oslo_db.sqlalchemy.engines [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75621) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:42:39 devstack cinder-volume[75621]: DEBUG dbcounter [-] [75621] Writer thread running {{(pid=75621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 23:42:39 devstack cinder-volume[75621]: DEBUG cinder.db.api [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Building query based on filter {{(pid=75621) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 03 23:42:39 devstack cinder-volume[75621]: DEBUG cinder.image.image_utils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75621) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 03 23:42:39 devstack cinder-volume[75621]: INFO cinder.keymgr.migration [None req-8974b143-00b4-4b6a-905a-1f832a9f517c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 23:42:39 devstack cinder-volume[75621]: DEBUG cinder.volume.drivers.lvm [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Updating volume stats {{(pid=75621) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 23:42:39 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:39 devstack sudo[76723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:42:39 devstack sudo[76723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:40 devstack sudo[76723]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:40 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.707s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:40 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:40 devstack sudo[76727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:42:40 devstack sudo[76727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:41 devstack sudo[76727]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:41 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:41 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:41 devstack sudo[76731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:42:41 devstack sudo[76731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:41 devstack sudo[76731]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:41 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.669s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:41 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:41 devstack sudo[76734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:42:41 devstack sudo[76734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:42 devstack sudo[76734]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:42 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.756s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:42 devstack cinder-volume[75621]: DEBUG cinder.manager [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Notifying Schedulers of capabilities ... {{(pid=75621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:42:42 devstack cinder-volume[75621]: INFO cinder.volume.manager [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Driver initialization completed successfully.
Jul 03 23:42:42 devstack cinder-volume[75621]: INFO cinder.manager [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Initiating service 2 cleanup
Jul 03 23:42:42 devstack cinder-volume[75621]: INFO cinder.manager [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Service 2 cleanup completed.
Jul 03 23:42:42 devstack cinder-volume[75621]: DEBUG cinder.service [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Creating RPC server for service cinder-volume {{(pid=75621) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 23:42:42 devstack cinder-volume[75621]: DEBUG cinder.service [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75621) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 23:42:42 devstack cinder-volume[75621]: INFO cinder.volume.manager [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 03 23:42:42 devstack cinder-volume[75621]: DEBUG cinder.volume.drivers.lvm [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Updating volume stats {{(pid=75621) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 23:42:42 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:42 devstack sudo[76741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:42:42 devstack sudo[76741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:43 devstack sudo[76741]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:43 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:43 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:43 devstack sudo[76782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:42:43 devstack sudo[76782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:43 devstack sudo[76782]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:43 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:43 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:43 devstack sudo[76801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:42:43 devstack sudo[76801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:44 devstack sudo[76801]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:44 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:44 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:42:44 devstack sudo[76804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:42:44 devstack sudo[76804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:42:45 devstack sudo[76804]: pam_unix(sudo:session): session closed for user root
Jul 03 23:42:45 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:42:45 devstack cinder-volume[75621]: INFO cinder.volume.manager [None req-febebb03-a6a5-406d-8352-3e9c5f3041ae None None] Driver post RPC initialization completed successfully.
Jul 03 23:42:55 devstack cinder-volume[75621]: DEBUG dbcounter [-] [75621] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:42:55 devstack cinder-volume[75621]: DEBUG dbcounter [-] [75621] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:43:27 devstack cinder-volume[75621]: DEBUG oslo_service.periodic_task [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:43:27 devstack cinder-volume[75621]: DEBUG cinder.volume.drivers.lvm [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Updating volume stats {{(pid=75621) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 23:43:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:27 devstack sudo[78353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:43:27 devstack sudo[78353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:27 devstack sudo[78353]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:27 devstack sudo[78420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:43:27 devstack sudo[78420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:28 devstack sudo[78420]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:28 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.599s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:28 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:28 devstack sudo[78423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:43:28 devstack sudo[78423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:29 devstack sudo[78423]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:29 devstack sudo[78426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:43:29 devstack sudo[78426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:29 devstack sudo[78426]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:29 devstack cinder-volume[75621]: DEBUG cinder.manager [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Notifying Schedulers of capabilities ... {{(pid=75621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:43:29 devstack cinder-volume[75621]: DEBUG oslo_service.periodic_task [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running periodic task VolumeManager._thread_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:43:29 devstack cinder-volume[75621]: DEBUG cinder.volume.manager [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] thread count: 6 {{(pid=75621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:43:29 devstack cinder-volume[75621]: DEBUG cinder.volume.manager [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] thread info: [<_MainThread(MainThread, started 127863597318272)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127863521552384)>, <Thread(Thread-3 (stat_writer), started daemon 127863487459904)>, <Thread(Rabbit-heartbeat, started daemon 127863484891392)>, <Thread(Thread-5 (_runner), started daemon 127863485043712)>, <Thread(Thread-7 (_runner), started daemon 127863485054336)>] {{(pid=75621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:44:27 devstack cinder-volume[75621]: DEBUG oslo_service.periodic_task [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:44:27 devstack cinder-volume[75621]: DEBUG cinder.volume.drivers.lvm [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Updating volume stats {{(pid=75621) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 23:44:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:44:27 devstack sudo[81723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:44:27 devstack sudo[81723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:44:27 devstack sudo[81723]: pam_unix(sudo:session): session closed for user root
Jul 03 23:44:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:44:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:44:27 devstack sudo[81726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:44:27 devstack sudo[81726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:44:28 devstack sudo[81726]: pam_unix(sudo:session): session closed for user root
Jul 03 23:44:28 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.609s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:44:28 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:44:28 devstack sudo[81729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:44:28 devstack sudo[81729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:44:29 devstack sudo[81729]: pam_unix(sudo:session): session closed for user root
Jul 03 23:44:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.610s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:44:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:44:29 devstack sudo[81732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:44:29 devstack sudo[81732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:44:29 devstack sudo[81732]: pam_unix(sudo:session): session closed for user root
Jul 03 23:44:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:44:29 devstack cinder-volume[75621]: DEBUG cinder.manager [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Notifying Schedulers of capabilities ... {{(pid=75621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:44:55 devstack cinder-volume[75621]: DEBUG dbcounter [-] [75621] Writing DB stats cinder:SELECT=1 {{(pid=75621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:44:55 devstack cinder-volume[75621]: DEBUG dbcounter [-] [75621] Writing DB stats cinder:UPDATE=1 {{(pid=75621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:45:27 devstack cinder-volume[75621]: DEBUG oslo_service.periodic_task [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running periodic task VolumeManager._thread_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:45:27 devstack cinder-volume[75621]: DEBUG cinder.volume.manager [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] thread count: 6 {{(pid=75621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:45:27 devstack cinder-volume[75621]: DEBUG cinder.volume.manager [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] thread info: [<_MainThread(MainThread, started 127863597318272)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127863521552384)>, <Thread(Thread-3 (stat_writer), started daemon 127863487459904)>, <Thread(Rabbit-heartbeat, started daemon 127863484891392)>, <Thread(Thread-5 (_runner), started daemon 127863485043712)>, <Thread(Thread-7 (_runner), started daemon 127863485054336)>] {{(pid=75621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:46:27 devstack cinder-volume[75621]: DEBUG oslo_service.periodic_task [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:46:27 devstack cinder-volume[75621]: DEBUG cinder.volume.drivers.lvm [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Updating volume stats {{(pid=75621) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 03 23:46:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:46:27 devstack sudo[84904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:46:27 devstack sudo[84904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:46:27 devstack sudo[84904]: pam_unix(sudo:session): session closed for user root
Jul 03 23:46:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:46:27 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:46:27 devstack sudo[84920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:46:27 devstack sudo[84920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:46:28 devstack sudo[84920]: pam_unix(sudo:session): session closed for user root
Jul 03 23:46:28 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:46:28 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:46:28 devstack sudo[84923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:46:28 devstack sudo[84923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:46:29 devstack sudo[84923]: pam_unix(sudo:session): session closed for user root
Jul 03 23:46:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:46:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:46:29 devstack sudo[84929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:46:29 devstack sudo[84929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:46:29 devstack sudo[84929]: pam_unix(sudo:session): session closed for user root
Jul 03 23:46:29 devstack cinder-volume[75621]: DEBUG oslo_concurrency.processutils [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:46:29 devstack cinder-volume[75621]: DEBUG cinder.manager [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Notifying Schedulers of capabilities ... {{(pid=75621) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:46:29 devstack cinder-volume[75621]: DEBUG oslo_service.periodic_task [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] Running periodic task VolumeManager._thread_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:46:29 devstack cinder-volume[75621]: DEBUG cinder.volume.manager [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] thread count: 6 {{(pid=75621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:46:29 devstack cinder-volume[75621]: DEBUG cinder.volume.manager [None req-114ca84b-f9c5-4a57-be97-d13ef2d4ce99 None None] thread info: [<_MainThread(MainThread, started 127863597318272)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 127863521552384)>, <Thread(Thread-3 (stat_writer), started daemon 127863487459904)>, <Thread(Rabbit-heartbeat, started daemon 127863484891392)>, <Thread(Thread-5 (_runner), started daemon 127863485043712)>, <Thread(Thread-7 (_runner), started daemon 127863485054336)>] {{(pid=75621) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:46:55 devstack cinder-volume[75621]: DEBUG dbcounter [-] [75621] Writing DB stats cinder:SELECT=1 {{(pid=75621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:46:55 devstack cinder-volume[75621]: DEBUG dbcounter [-] [75621] Writing DB stats cinder:UPDATE=1 {{(pid=75621) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:46:59 devstack cinder-volume[75441]: INFO oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Caught SIGTERM, stopping children
Jul 03 23:46:59 devstack cinder-volume[75441]: DEBUG oslo_concurrency.lockutils [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Acquiring lock "singleton_lock" {{(pid=75441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:46:59 devstack cinder-volume[75441]: DEBUG oslo_concurrency.lockutils [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Acquired lock "singleton_lock" {{(pid=75441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:46:59 devstack cinder-volume[75441]: DEBUG oslo_concurrency.lockutils [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Releasing lock "singleton_lock" {{(pid=75441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:46:59 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Stop services. {{(pid=75441) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 03 23:46:59 devstack cinder-volume[75441]: DEBUG oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Killing children. {{(pid=75441) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 03 23:46:59 devstack cinder-volume[75441]: INFO oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Waiting on 1 children to exit
Jul 03 23:47:02 devstack cinder-volume[75621]: DEBUG oslo_concurrency.lockutils [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Acquiring lock "singleton_lock" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:47:02 devstack cinder-volume[75621]: DEBUG oslo_concurrency.lockutils [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Acquired lock "singleton_lock" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:47:02 devstack cinder-volume[75621]: DEBUG oslo_concurrency.lockutils [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Releasing lock "singleton_lock" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:47:02 devstack cinder-volume[75621]: WARNING amqp [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 23:47:02 devstack cinder-volume[75621]: WARNING amqp [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 23:47:02 devstack cinder-volume[75441]: INFO oslo_service.backend._eventlet.service [None req-33061616-c2d4-4a12-8182-503511fe6cdd None None] Child 75621 exited with status 0
Jul 03 23:47:03 devstack cinder-volume[85731]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 23:47:03 devstack cinder-volume[85731]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 23:47:03 devstack cinder-volume[85731]: we strongly recommend against using it for new projects.
Jul 03 23:47:03 devstack cinder-volume[85731]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 23:47:03 devstack cinder-volume[85731]: framework.  For more detail see
Jul 03 23:47:03 devstack cinder-volume[85731]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 23:47:03 devstack cinder-volume[85731]:   import eventlet  # noqa
Jul 03 23:47:05 devstack cinder-volume[85731]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:47:05 devstack cinder-volume[85731]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:47:05 devstack cinder-volume[85731]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:47:05 devstack cinder-volume[85731]: INFO dbcounter [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Registered counter for database cinder
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_db.sqlalchemy.engines [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG dbcounter [-] [85731] Writer thread running {{(pid=85731) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 23:47:06 devstack cinder-volume[85731]: INFO cinder.rpc [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 23:47:06 devstack cinder-volume[85731]: INFO cinder.rpc [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_db.sqlalchemy.engines [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:47:06 devstack cinder-volume[85731]: INFO cinder.volume.manager [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Determined volume DB was empty at startup.
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG cinder.volume.manager [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85731) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 03 23:47:06 devstack cinder-volume[85731]: INFO cinder.volume.manager [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 03 23:47:06 devstack cinder-volume[85731]: WARNING stevedore.named [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 23:47:06 devstack cinder-volume[85731]: WARNING castellan.key_manager [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:47:06 devstack cinder-volume[85731]: WARNING cinder.keymgr.conf_key_mgr [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:47:06 devstack cinder-volume[85731]: INFO cinder.volume.manager [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_db.sqlalchemy.engines [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85731) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:47:06 devstack cinder-volume[85731]: INFO oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Starting 1 workers
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Started child 85947 {{(pid=85731) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Full set of CONF: {{(pid=85731) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] ******************************************************************************** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Configuration options gathered from: {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 23:47:06 devstack cinder-volume[85947]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] ================================================================================ {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] allow_availability_zone_fallback = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] allow_compression_on_image_upload = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] allowed_direct_url_schemes     = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] api_rate_limit                 = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] auth_strategy                  = keystone {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_availability_zone      = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_host                   = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_name                   = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_stats_polling_interval = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backup_api_class               = cinder.backup.api.API {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backup_name_template           = backup-%s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backup_use_same_host           = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backup_use_temp_snapshot       = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] chap_password                  = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] chap_username                  =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cinder_internal_tenant_project_id = c326a393311240bc90ca15745c928477 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cinder_internal_tenant_user_id = efc58a4073384bcf8551752a40f0271f {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cluster                        = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] compression_format             = gzip {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] compute_api_class              = cinder.compute.nova.API {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] config_dir                     = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] config_source                  = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] control_exchange               = openstack {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] debug                          = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] default_availability_zone      = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] default_group_type             = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] default_volume_type            = QuobyteHD {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] disk_geometry                  = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] driver_client_cert             = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] driver_client_cert_key         = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] driver_data_namespace          = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] driver_ssl_cert_path           = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] driver_ssl_cert_verify         = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] driver_use_ssl                 = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] enable_new_services            = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] enable_unsupported_driver      = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] enabled_backends               = ['QuobyteHD'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] enforce_multipath_for_image_xfer = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] filter_function                = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance_api_insecure            = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance_api_servers             = ['http://192.168.122.251/image'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance_api_ssl_compression     = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance_ca_certificates_file    = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance_catalog_info            = image:glance:publicURL {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance_certfile                = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance_keyfile                 = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance_num_retries             = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance_request_timeout         = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] goodness_function              = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] graceful_shutdown_timeout      = 5 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] group_api_class                = cinder.group.api.API {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] host                           = devstack {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] image_compress_on_upload       = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] image_conversion_address_space_limit = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] image_conversion_cpu_limit     = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] image_conversion_disable       = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] image_upload_use_cinder_backend = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] image_upload_use_internal_tenant = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] image_volume_cache_enabled     = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] image_volume_cache_max_count   = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] image_volume_cache_max_size_gb = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] init_host_max_objects_retrieval = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] instance_format                = [instance: %(uuid)s]  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] iscsi_target_flags             =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] iscsi_write_cache              = on {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] iser_helper                    = tgtadm {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] iser_ip_address                = 192.168.122.251 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] iser_port                      = 3260 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] log_color                      = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] log_config_append              = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] log_dir                        = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] log_file                       = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85947]: INFO cinder.volume.manager [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 03 23:47:06 devstack cinder-volume[85947]: DEBUG cinder.volume.drivers.remotefs [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85947) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] log_options                    = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] log_rotate_interval            = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] log_rotate_interval_type       = days {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] log_rotation_type              = none {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] max_age                        = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] max_logfile_count              = 30 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] max_logfile_size_mb            = 200 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] max_over_subscription_ratio    = 20.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] message_reap_interval          = 86400 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] message_ttl                    = 2592000 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] migration_create_volume_timeout_secs = 300 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] monkey_patch                   = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] monkey_patch_modules           = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] my_ip                          = 192.168.122.251 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] no_snapshot_gb_quota           = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] num_iser_scan_tries            = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] num_shell_tries                = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] num_volume_device_scan_tries   = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] nvmeof_conn_info_version       = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] nvmet_ns_id                    = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] nvmet_port_id                  = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] osapi_max_limit                = 1000 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] osapi_volume_ext_list          = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] osapi_volume_listen_port       = 8776 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] osapi_volume_use_ssl           = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] osapi_volume_workers           = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] per_volume_size_limit          = -1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] periodic_fuzzy_delay           = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] periodic_interval              = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] public_endpoint                = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] publish_errors                 = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] quota_backup_gigabytes         = 1000 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] quota_backups                  = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] quota_gigabytes                = 1000 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] quota_groups                   = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] quota_snapshots                = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] quota_volumes                  = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] rate_limit_burst               = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] rate_limit_except_level        = CRITICAL {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] rate_limit_interval            = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] reinit_driver_count            = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] replication_device             = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] report_discard_supported       = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] report_interval                = 120 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] reservation_clean_interval     = 86400 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] reservation_expire             = 86400 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] reserved_image_namespaces      = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] reserved_percentage            = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] rpc_response_timeout           = 120 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] run_external_periodic_tasks    = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] scst_target_driver             = iscsi {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] scst_target_iqn_name           = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] service_down_time              = 720 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] shell_completion               = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] snapshot_name_template         = snapshot-%s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] split_loggers                  = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] state_path                     = /opt/stack/data/cinder {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] storage_availability_zone      = nova {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] storage_protocol               = iSCSI {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] syslog_log_facility            = LOG_USER {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85947]: DEBUG cinder.volume.drivers.quobyte [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85947) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 03 23:47:06 devstack cinder-volume[85947]: WARNING cinder.volume.drivers.quobyte [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 03 23:47:06 devstack cinder-volume[85947]: WARNING cinder.volume.drivers.quobyte [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] target_helper                  = lioadm {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] target_ip_address              = 192.168.122.251 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] target_port                    = 3260 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] target_protocol                = iscsi {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85947]: DEBUG oslo_concurrency.processutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Running cmd (subprocess): mount.quobyte {{(pid=85947) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] target_secondary_ip_addresses  = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] trace_flags                    = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] transport_url                  = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] until_refresh                  = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] use_chap_auth                  = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] use_default_quota_class        = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] use_journal                    = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] use_json                       = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] use_multipath_for_image_xfer   = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] use_stderr                     = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] use_syslog                     = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] verify_glance_signatures       = enabled {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volume_api_class               = cinder.volume.api.API {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volume_backend_name            = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volume_clear                   = zero {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volume_clear_ionice            = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volume_clear_size              = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volume_copy_bps_limit          = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volume_dd_blocksize            = 1M {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volume_name_template           = volume-%s {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volume_service_inithost_offload = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volume_usage_audit_period      = month {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] zoning_mode                    = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_concurrency.disable_process_locking = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.auth_section = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.auth_type   = password {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.auth_version = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.cache       = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.certfile    = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.include_service_catalog = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.insecure    = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.interface   = public {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.keyfile     = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_password =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcache_username =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.region_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.service_type = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.backend                  = dogpile.cache.null {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.backend_argument         = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.backend_expiration_time  = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.config_prefix            = cache.oslo {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.debug_cache_backend      = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.enable_retry_client      = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.enable_socket_keepalive  = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.enabled                  = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.expiration_time          = 600 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.hashclient_retry_attempts = 2 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.memcache_dead_retry      = 300 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.memcache_pool_maxsize    = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.memcache_sasl_enabled    = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.password                 = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.proxies                  = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.redis_db                 = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.redis_server             = localhost:6379 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.retry_attempts           = 2 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack quobyte-client[85950]: Reading configuration file: /etc/quobyte/client.cfg
Jul 03 23:47:06 devstack quobyte-client[85950]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.retry_delay              = 0.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.socket_keepalive_count   = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.socket_keepalive_idle    = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:06 devstack cinder-volume[85947]: DEBUG oslo_concurrency.processutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=85947) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.socket_keepalive_interval = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.socket_timeout           = 1.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.tls_allowed_ciphers      = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.tls_cafile               = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85947) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.tls_certfile             = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85947) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.tls_enabled              = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85947]: DEBUG cinder.volume.drivers.quobyte [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=85947) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.tls_keyfile              = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cache.username                 = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] coordination.backend_url       = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.asyncio_connection    = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.asyncio_slave_connection = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.backend               = sqlalchemy {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.connection            = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.connection_debug      = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85947]: INFO cinder.volume.drivers.quobyte [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 ...
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.connection_parameters =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85947]: DEBUG oslo_concurrency.processutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 -c /etc/quobyte/client-cinder.cfg {{(pid=85947) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.connection_recycle_time = 3600 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.connection_trace      = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.db_inc_retry_interval = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.db_max_retries        = 20 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.db_max_retry_interval = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.db_retry_interval     = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.max_overflow          = 50 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.max_pool_size         = 5 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.max_retries           = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.mysql_wsrep_sync_wait = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.pool_timeout          = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.retry_interval        = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.slave_connection      = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.sqlite_synchronous    = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.synchronous_reader    = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] database.use_db_reconnect      = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler.connection_string     = messaging:// {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler.enabled               = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler.es_doc_type           = notification {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler.es_scroll_size        = 10000 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler.es_scroll_time        = 2m {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler.filter_error_trace    = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler.hmac_keys             = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler.sentinel_service_name = mymaster {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler.socket_timeout        = 0.1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler.trace_requests        = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler.trace_sqlalchemy      = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler_jaeger.process_tags   = {} {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler_jaeger.service_name_prefix = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] profiler_otlp.service_name_prefix = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_policy.enforce_new_defaults = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_policy.enforce_scope      = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_policy.policy_default_rule = default {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_policy.policy_file        = policy.yaml {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] privsep_osbrick.group          = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] privsep_osbrick.helper_command = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] privsep_osbrick.user           = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cinder_sys_admin.group         = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cinder_sys_admin.helper_command = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] cinder_sys_admin.user          = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] service_user.auth_section      = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] service_user.auth_type         = password {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] service_user.cafile            = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] service_user.certfile          = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] service_user.collect_timing    = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] service_user.insecure          = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] service_user.keyfile           = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] service_user.send_service_user_token = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] service_user.split_loggers     = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] service_user.timeout           = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance.auth_section            = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance.auth_type               = password {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance.certfile                = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance.collect_timing          = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance.insecure                = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance.keyfile                 = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance.region_name             = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance.split_loggers           = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] glance.timeout                 = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.backend_availability_zone = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.chap_password = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.chap_username =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.disk_geometry = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.driver_client_cert = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.driver_client_cert_key = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.driver_data_namespace = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.driver_use_ssl = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.extra_capabilities = {} {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.filter_function = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.goodness_function = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.iscsi_target_flags =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.iscsi_write_cache = on {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.iser_helper   = tgtadm {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.iser_port     = 3260 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nas_host      =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nas_login     = admin {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nas_mount_options = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nas_password  = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nas_private_key =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nas_share_path =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.num_shell_tries = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.quobyte_volume_url = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.replication_device = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.report_discard_supported = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.reserved_percentage = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack sudo[85953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 -c /etc/quobyte/client-cinder.cfg
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.target_helper = tgtadm {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.target_port   = 3260 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack sudo[85953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.target_protocol = iscsi {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.trace_flags   = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.unique_fqdn_network = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.use_chap_auth = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.volume_backend_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.volume_clear  = zero {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.volume_clear_ionice = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.volume_clear_size = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_reports.file_event_handler = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_reports.log_dir           = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.backend_availability_zone = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.backend_host         = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.chap_password        = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.chap_username        = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.chiscsi_conf         = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.disk_geometry        = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.driver_client_cert   = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.driver_data_namespace = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.driver_use_ssl       = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.extra_capabilities   = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.filter_function      = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.goodness_function    = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.iser_helper          = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.iser_ip_address      = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.iser_port            = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.iser_target_prefix   = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nas_host             = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nas_login            = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nas_mount_options    = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nas_password         = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nas_private_key      = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nas_share_path       = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nas_ssh_port         = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.num_shell_tries      = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.nvmet_port_id        = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.replication_device   = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.report_discard_supported = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.reserved_percentage  = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.scst_target_driver   = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.storage_protocol     = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.target_helper        = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.target_ip_address    = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.target_port          = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.target_prefix        = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.target_protocol      = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.trace_flags          = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.use_chap_auth        = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.volume_clear         = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.volume_clear_size    = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] QuobyteHD.volumes_dir          = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.ssl      = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_notifications.driver = [] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_notifications.retry = -1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] key_manager.fixed_key          = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.barbican_api_version  = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.barbican_endpoint     = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.barbican_endpoint_type = public {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.barbican_region_name  = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.cafile                = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.certfile              = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.collect_timing        = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.insecure              = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.keyfile               = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.number_of_retries     = 60 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.retry_delay           = 1 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.send_service_user_token = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.split_loggers         = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.timeout               = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.verify_ssl            = True {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican.verify_ssl_path       = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican_service_user.auth_section = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican_service_user.auth_type = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican_service_user.cafile   = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican_service_user.certfile = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican_service_user.collect_timing = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican_service_user.insecure = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican_service_user.keyfile  = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican_service_user.split_loggers = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] barbican_service_user.timeout  = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] vault.approle_role_id          = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] vault.approle_secret_id        = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] vault.kv_mountpoint            = secret {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] vault.kv_path                  = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] vault.kv_version               = 2 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] vault.namespace                = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] vault.root_token_id            = **** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] vault.ssl_ca_crt_file          = None {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] vault.timeout                  = 60.0 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] vault.use_ssl                  = False {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:07 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] ******************************************************************************** {{(pid=85731) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 23:47:07 devstack sudo[85953]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:07 devstack cinder-volume[85947]: DEBUG oslo_concurrency.processutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.916s {{(pid=85947) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:07 devstack cinder-volume[85947]: INFO cinder.volume.drivers.quobyte [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 succeeded
Jul 03 23:47:07 devstack cinder-volume[85947]: DEBUG cinder.volume.drivers.quobyte [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=85947) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:47:07 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.931s {{(pid=85947) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:47:07 devstack cinder-volume[85947]: DEBUG oslo_concurrency.processutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=85947) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:07 devstack sudo[86022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:47:07 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:08 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:08 devstack cinder-volume[85947]: DEBUG oslo_concurrency.processutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.731s {{(pid=85947) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:08 devstack cinder-volume[85947]: INFO cinder.volume.driver [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 23:47:08 devstack cinder-volume[85947]: DEBUG cinder.volume.driver [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85947) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 03 23:47:08 devstack cinder-volume[85947]: DEBUG oslo_db.sqlalchemy.engines [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85947) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:47:08 devstack cinder-volume[85947]: DEBUG dbcounter [-] [85947] Writer thread running {{(pid=85947) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 23:47:08 devstack cinder-volume[85947]: DEBUG cinder.db.api [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Building query based on filter {{(pid=85947) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 03 23:47:08 devstack cinder-volume[85947]: DEBUG cinder.image.image_utils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85947) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 03 23:47:08 devstack cinder-volume[85947]: INFO cinder.keymgr.migration [None req-0c873a7a-bc98-4ba1-8efc-7b46f98bc05a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 23:47:08 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85947) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:47:08 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85947) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:47:08 devstack cinder-volume[85947]: DEBUG cinder.volume.drivers.quobyte [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=85947) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:47:08 devstack cinder-volume[85947]: DEBUG cinder.volume.drivers.quobyte [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=85947) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:47:08 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85947) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:47:08 devstack cinder-volume[85947]: DEBUG oslo_concurrency.processutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=85947) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:08 devstack sudo[86032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:47:08 devstack sudo[86032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:09 devstack sudo[86032]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:09 devstack cinder-volume[85947]: DEBUG oslo_concurrency.processutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.123s {{(pid=85947) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:09 devstack cinder-volume[85947]: DEBUG cinder.manager [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Notifying Schedulers of capabilities ... {{(pid=85947) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:47:10 devstack cinder-volume[85947]: INFO cinder.volume.manager [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Driver initialization completed successfully.
Jul 03 23:47:10 devstack cinder-volume[85947]: INFO cinder.manager [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Initiating service 3 cleanup
Jul 03 23:47:10 devstack cinder-volume[85947]: INFO cinder.manager [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Service 3 cleanup completed.
Jul 03 23:47:10 devstack cinder-volume[85947]: DEBUG cinder.service [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Creating RPC server for service cinder-volume {{(pid=85947) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 23:47:10 devstack cinder-volume[85947]: DEBUG cinder.service [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85947) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 23:47:10 devstack cinder-volume[85947]: INFO cinder.volume.manager [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 03 23:47:10 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85947) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:47:10 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=85947) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:47:10 devstack cinder-volume[85947]: DEBUG cinder.volume.drivers.quobyte [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=85947) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:47:10 devstack cinder-volume[85947]: DEBUG cinder.volume.drivers.quobyte [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=85947) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:47:10 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85947) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:47:10 devstack cinder-volume[85947]: DEBUG oslo_concurrency.processutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=85947) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:10 devstack sudo[86140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:47:10 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:11 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:11 devstack cinder-volume[85947]: DEBUG oslo_concurrency.processutils [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.743s {{(pid=85947) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:11 devstack cinder-volume[85947]: INFO cinder.volume.manager [None req-637171b3-3a5f-457b-bceb-5f72337722ee None None] Driver post RPC initialization completed successfully.
Jul 03 23:47:13 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-3e12894c-b318-4bf1-a665-419ca5baa618 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85947) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:47:13 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-3e12894c-b318-4bf1-a665-419ca5baa618 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85947) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:47:13 devstack cinder-volume[85947]: DEBUG cinder.volume.drivers.quobyte [None req-3e12894c-b318-4bf1-a665-419ca5baa618 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=85947) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:47:13 devstack cinder-volume[85947]: DEBUG cinder.volume.drivers.quobyte [None req-3e12894c-b318-4bf1-a665-419ca5baa618 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=85947) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:47:13 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-3e12894c-b318-4bf1-a665-419ca5baa618 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85947) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:47:13 devstack cinder-volume[85947]: DEBUG oslo_concurrency.processutils [None req-3e12894c-b318-4bf1-a665-419ca5baa618 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=85947) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:13 devstack sudo[86162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:47:13 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:14 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:14 devstack cinder-volume[85947]: DEBUG oslo_concurrency.processutils [None req-3e12894c-b318-4bf1-a665-419ca5baa618 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.604s {{(pid=85947) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:14 devstack cinder-volume[85947]: DEBUG cinder.manager [None req-3e12894c-b318-4bf1-a665-419ca5baa618 None None] Notifying Schedulers of capabilities ... {{(pid=85947) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:47:15 devstack cinder-volume[85731]: INFO oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Caught SIGTERM, stopping children
Jul 03 23:47:15 devstack cinder-volume[85731]: DEBUG oslo_concurrency.lockutils [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Acquiring lock "singleton_lock" {{(pid=85731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:47:15 devstack cinder-volume[85731]: DEBUG oslo_concurrency.lockutils [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Acquired lock "singleton_lock" {{(pid=85731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:47:15 devstack cinder-volume[85731]: DEBUG oslo_concurrency.lockutils [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Releasing lock "singleton_lock" {{(pid=85731) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:47:15 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Stop services. {{(pid=85731) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 03 23:47:15 devstack cinder-volume[85731]: DEBUG oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Killing children. {{(pid=85731) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 03 23:47:15 devstack cinder-volume[85731]: INFO oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Waiting on 1 children to exit
Jul 03 23:47:18 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Acquiring lock "singleton_lock" {{(pid=85947) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:47:18 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Acquired lock "singleton_lock" {{(pid=85947) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:47:18 devstack cinder-volume[85947]: DEBUG oslo_concurrency.lockutils [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Releasing lock "singleton_lock" {{(pid=85947) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:47:18 devstack cinder-volume[85947]: WARNING amqp [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 23:47:18 devstack cinder-volume[85947]: WARNING amqp [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 23:47:18 devstack cinder-volume[85731]: INFO oslo_service.backend._eventlet.service [None req-ee46fd50-ff9b-4c27-944e-b9e2247b80a6 None None] Child 85947 exited with status 0
Jul 03 23:47:19 devstack cinder-volume[86324]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 23:47:19 devstack cinder-volume[86324]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 23:47:19 devstack cinder-volume[86324]: we strongly recommend against using it for new projects.
Jul 03 23:47:19 devstack cinder-volume[86324]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 23:47:19 devstack cinder-volume[86324]: framework.  For more detail see
Jul 03 23:47:19 devstack cinder-volume[86324]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 23:47:19 devstack cinder-volume[86324]:   import eventlet  # noqa
Jul 03 23:47:22 devstack cinder-volume[86324]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86324) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:47:22 devstack cinder-volume[86324]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86324) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:47:22 devstack cinder-volume[86324]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86324) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:47:23 devstack cinder-volume[86324]: INFO dbcounter [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] Registered counter for database cinder
Jul 03 23:47:23 devstack cinder-volume[86324]: DEBUG oslo_db.sqlalchemy.engines [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86324) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG dbcounter [-] [86324] Writer thread running {{(pid=86324) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 23:47:24 devstack cinder-volume[86324]: INFO cinder.rpc [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 23:47:24 devstack cinder-volume[86324]: INFO cinder.rpc [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_db.sqlalchemy.engines [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86324) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:47:24 devstack cinder-volume[86324]: INFO cinder.volume.manager [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] Determined volume DB was empty at startup.
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG cinder.volume.manager [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86324) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 03 23:47:24 devstack cinder-volume[86324]: WARNING stevedore.named [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 23:47:24 devstack cinder-volume[86324]: WARNING castellan.key_manager [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:47:24 devstack cinder-volume[86324]: WARNING cinder.keymgr.conf_key_mgr [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:47:24 devstack cinder-volume[86324]: INFO cinder.volume.manager [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_db.sqlalchemy.engines [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86324) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:47:24 devstack cinder-volume[86324]: INFO oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] Starting 1 workers
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] Started child 86648 {{(pid=86324) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] Full set of CONF: {{(pid=86324) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] ******************************************************************************** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] Configuration options gathered from: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] ================================================================================ {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] allow_availability_zone_fallback = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] allow_compression_on_image_upload = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] allowed_direct_url_schemes     = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] api_rate_limit                 = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] auth_strategy                  = keystone {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_availability_zone      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_host                   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_name                   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_stats_polling_interval = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backup_api_class               = cinder.backup.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backup_name_template           = backup-%s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backup_use_same_host           = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backup_use_temp_snapshot       = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] chap_password                  = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] chap_username                  =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cinder_internal_tenant_project_id = c326a393311240bc90ca15745c928477 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cinder_internal_tenant_user_id = efc58a4073384bcf8551752a40f0271f {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cluster                        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] compression_format             = gzip {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] config_dir                     = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] config_source                  = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] control_exchange               = openstack {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] debug                          = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] default_availability_zone      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] default_group_type             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] default_volume_type            = QuobyteHD {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] disk_geometry                  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] driver_client_cert             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86648]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] driver_client_cert_key         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] driver_data_namespace          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] driver_ssl_cert_path           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] driver_ssl_cert_verify         = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] driver_use_ssl                 = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] enable_new_services            = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] enable_unsupported_driver      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] enforce_multipath_for_image_xfer = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] filter_function                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance_api_insecure            = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance_api_servers             = ['http://192.168.122.251/image'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance_api_ssl_compression     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance_ca_certificates_file    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance_certfile                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance_keyfile                 = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance_num_retries             = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance_request_timeout         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] goodness_function              = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] graceful_shutdown_timeout      = 5 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] group_api_class                = cinder.group.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] host                           = devstack {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] image_compress_on_upload       = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] image_conversion_address_space_limit = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] image_conversion_cpu_limit     = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] image_conversion_disable       = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] image_upload_use_cinder_backend = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] image_upload_use_internal_tenant = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] image_volume_cache_enabled     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] image_volume_cache_max_count   = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] image_volume_cache_max_size_gb = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] init_host_max_objects_retrieval = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] iscsi_target_flags             =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] iscsi_write_cache              = on {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] iser_helper                    = tgtadm {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] iser_ip_address                = 192.168.122.251 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] iser_port                      = 3260 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] log_color                      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] log_config_append              = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] log_dir                        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] log_file                       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] log_options                    = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] log_rotate_interval            = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] log_rotate_interval_type       = days {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] log_rotation_type              = none {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] max_age                        = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] max_logfile_count              = 30 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] max_logfile_size_mb            = 200 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] max_over_subscription_ratio    = 20.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] message_reap_interval          = 86400 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] message_ttl                    = 2592000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] migration_create_volume_timeout_secs = 300 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] monkey_patch                   = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] monkey_patch_modules           = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] my_ip                          = 192.168.122.251 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] no_snapshot_gb_quota           = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] num_iser_scan_tries            = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] num_shell_tries                = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] num_volume_device_scan_tries   = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] nvmeof_conn_info_version       = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] nvmet_ns_id                    = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] nvmet_port_id                  = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] osapi_max_limit                = 1000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] osapi_volume_ext_list          = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] osapi_volume_listen_port       = 8776 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] osapi_volume_use_ssl           = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] osapi_volume_workers           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] per_volume_size_limit          = -1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] periodic_fuzzy_delay           = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] periodic_interval              = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86648) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] public_endpoint                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] publish_errors                 = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] quota_backup_gigabytes         = 1000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] quota_backups                  = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] quota_gigabytes                = 1000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] quota_groups                   = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] quota_snapshots                = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] quota_volumes                  = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] rate_limit_burst               = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] rate_limit_except_level        = CRITICAL {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] rate_limit_interval            = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] reinit_driver_count            = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] replication_device             = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] report_discard_supported       = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] report_interval                = 120 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] reservation_clean_interval     = 86400 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] reservation_expire             = 86400 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] reserved_image_namespaces      = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] reserved_percentage            = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] rpc_response_timeout           = 120 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] run_external_periodic_tasks    = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] scst_target_driver             = iscsi {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] scst_target_iqn_name           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] service_down_time              = 720 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] shell_completion               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] snapshot_name_template         = snapshot-%s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] split_loggers                  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] state_path                     = /opt/stack/data/cinder {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] storage_availability_zone      = nova {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] storage_protocol               = iSCSI {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] syslog_log_facility            = LOG_USER {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] target_helper                  = lioadm {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] target_ip_address              = 192.168.122.251 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] target_port                    = 3260 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] target_protocol                = iscsi {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] target_secondary_ip_addresses  = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] trace_flags                    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] transport_url                  = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] until_refresh                  = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] use_chap_auth                  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] use_default_quota_class        = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] use_journal                    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] use_json                       = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] use_multipath_for_image_xfer   = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] use_stderr                     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] use_syslog                     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] verify_glance_signatures       = enabled {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volume_api_class               = cinder.volume.api.API {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volume_backend_name            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volume_clear                   = zero {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volume_clear_ionice            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volume_clear_size              = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volume_copy_bps_limit          = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volume_dd_blocksize            = 1M {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volume_name_template           = volume-%s {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volume_service_inithost_offload = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volume_usage_audit_period      = month {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] zoning_mode                    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_concurrency.disable_process_locking = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.auth_section = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.auth_type   = password {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.auth_version = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.cache       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.certfile    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.include_service_catalog = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.insecure    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.interface   = public {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.keyfile     = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_password =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcache_username =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.region_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.service_type = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.251/identity {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.backend                  = dogpile.cache.null {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.backend_argument         = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.backend_expiration_time  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.config_prefix            = cache.oslo {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.debug_cache_backend      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.enable_retry_client      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.enable_socket_keepalive  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.enabled                  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.expiration_time          = 600 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.hashclient_retry_attempts = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.memcache_dead_retry      = 300 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.memcache_sasl_enabled    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.password                 = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.proxies                  = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.redis_db                 = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.redis_server             = localhost:6379 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.retry_attempts           = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.retry_delay              = 0.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.socket_keepalive_count   = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.socket_keepalive_idle    = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.socket_keepalive_interval = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.socket_timeout           = 1.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.tls_allowed_ciphers      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.tls_cafile               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.tls_certfile             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.tls_enabled              = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.tls_keyfile              = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cache.username                 = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] coordination.backend_url       = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.asyncio_connection    = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.asyncio_slave_connection = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.backend               = sqlalchemy {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.connection            = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.connection_debug      = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.connection_parameters =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.connection_recycle_time = 3600 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.connection_trace      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.db_inc_retry_interval = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.db_max_retries        = 20 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.db_max_retry_interval = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.db_retry_interval     = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.max_overflow          = 50 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.max_pool_size         = 5 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.max_retries           = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.mysql_wsrep_sync_wait = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.pool_timeout          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.retry_interval        = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.slave_connection      = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.sqlite_synchronous    = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.synchronous_reader    = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] database.use_db_reconnect      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86648) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 03 23:47:24 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.quobyte [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler.connection_string     = messaging:// {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler.enabled               = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler.es_doc_type           = notification {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler.es_scroll_size        = 10000 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.quobyte [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler.es_scroll_time        = 2m {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler.filter_error_trace    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler.hmac_keys             = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler.sentinel_service_name = mymaster {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler.socket_timeout        = 0.1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler.trace_requests        = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler.trace_sqlalchemy      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler_jaeger.process_tags   = {} {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler_jaeger.service_name_prefix = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] profiler_otlp.service_name_prefix = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_policy.enforce_new_defaults = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_policy.enforce_scope      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_policy.policy_default_rule = default {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] privsep_osbrick.group          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] privsep_osbrick.helper_command = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] privsep_osbrick.user           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Running cmd (subprocess): mount.quobyte {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cinder_sys_admin.group         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cinder_sys_admin.helper_command = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] cinder_sys_admin.user          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] service_user.auth_section      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] service_user.auth_type         = password {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] service_user.cafile            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] service_user.certfile          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] service_user.collect_timing    = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] service_user.insecure          = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] service_user.keyfile           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] service_user.send_service_user_token = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] service_user.split_loggers     = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] service_user.timeout           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance.auth_section            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance.auth_type               = password {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance.certfile                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance.collect_timing          = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance.insecure                = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance.keyfile                 = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance.region_name             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance.split_loggers           = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] glance.timeout                 = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.backend_availability_zone = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.chap_password = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.chap_username =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.disk_geometry = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.driver_client_cert = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.driver_client_cert_key = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.driver_data_namespace = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.driver_use_ssl = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.extra_capabilities = {} {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.filter_function = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.goodness_function = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.iscsi_target_flags =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.iscsi_write_cache = on {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.iser_ip_address = 192.168.122.251 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.iser_port     = 3260 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nas_host      =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nas_login     = admin {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nas_mount_options = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nas_password  = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nas_private_key =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nas_share_path =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.num_shell_tries = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.quobyte_volume_url = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.replication_device = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.report_discard_supported = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.reserved_percentage = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.target_helper = tgtadm {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.target_ip_address = 192.168.122.251 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.target_port   = 3260 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.target_protocol = iscsi {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.trace_flags   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.unique_fqdn_network = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.use_chap_auth = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.volume_backend_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.volume_clear  = zero {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.volume_clear_ionice = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.volume_clear_size = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_reports.file_event_handler = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_reports.log_dir           = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.backend_availability_zone = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.backend_host         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.chap_password        = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.chap_username        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.disk_geometry        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.driver_client_cert   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.driver_data_namespace = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.extra_capabilities   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.filter_function      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.goodness_function    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.iser_helper          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.iser_ip_address      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.iser_port            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nas_host             = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nas_login            = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nas_mount_options    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nas_password         = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nas_private_key      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nas_share_path       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.num_shell_tries      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.replication_device   = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.report_discard_supported = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.reserved_percentage  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.scst_target_driver   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.storage_protocol     = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.target_helper        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.target_ip_address    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.target_port          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.target_prefix        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.target_protocol      = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.trace_flags          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.use_chap_auth        = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.volume_clear         = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.volume_clear_size    = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] QuobyteHD.volumes_dir          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack quobyte-client[86652]: Reading configuration file: /etc/quobyte/client.cfg
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack quobyte-client[86652]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] CMD "mount.quobyte" returned: 1 in 0.096s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:47:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:47:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_notifications.driver = [] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_notifications.retry = -1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] key_manager.fixed_key          = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:47:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:47:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.barbican_api_version  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.barbican_endpoint     = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.barbican_endpoint_type = public {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.barbican_region_name  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.cafile                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.certfile              = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.collect_timing        = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.insecure              = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.keyfile               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.number_of_retries     = 60 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.retry_delay           = 1 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.send_service_user_token = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.split_loggers         = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.timeout               = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.verify_ssl            = True {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican.verify_ssl_path       = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican_service_user.auth_section = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican_service_user.auth_type = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican_service_user.cafile   = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican_service_user.certfile = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican_service_user.collect_timing = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican_service_user.insecure = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican_service_user.keyfile  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican_service_user.split_loggers = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] barbican_service_user.timeout  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] vault.approle_role_id          = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] vault.approle_secret_id        = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] vault.kv_mountpoint            = secret {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] vault.kv_path                  = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] vault.kv_version               = 2 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] vault.namespace                = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] vault.root_token_id            = **** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] vault.ssl_ca_crt_file          = None {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] vault.timeout                  = 60.0 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] vault.use_ssl                  = False {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:24 devstack cinder-volume[86324]: DEBUG oslo_service.backend._eventlet.service [None req-29cc7bbf-aed6-4dc8-b8d3-5c5ca4061dd2 None None] ******************************************************************************** {{(pid=86324) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 23:47:24 devstack sudo[86660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:47:24 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:25 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.695s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:25 devstack cinder-volume[86648]: INFO cinder.volume.driver [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 23:47:25 devstack cinder-volume[86648]: DEBUG cinder.volume.driver [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86648) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 03 23:47:25 devstack cinder-volume[86648]: DEBUG oslo_db.sqlalchemy.engines [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86648) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:47:25 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writer thread running {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 23:47:25 devstack cinder-volume[86648]: DEBUG cinder.db.api [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Building query based on filter {{(pid=86648) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 03 23:47:25 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86648) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 03 23:47:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:47:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:47:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:47:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:47:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:47:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:25 devstack cinder-volume[86648]: INFO cinder.keymgr.migration [None req-9bbf3567-0f1d-4d3e-a2b4-628967920a33 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 23:47:25 devstack sudo[86679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:47:25 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:26 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.682s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:26 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:47:26 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Driver initialization completed successfully.
Jul 03 23:47:26 devstack cinder-volume[86648]: INFO cinder.manager [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Initiating service 3 cleanup
Jul 03 23:47:26 devstack cinder-volume[86648]: INFO cinder.manager [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Service 3 cleanup completed.
Jul 03 23:47:26 devstack cinder-volume[86648]: DEBUG cinder.service [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Creating RPC server for service cinder-volume {{(pid=86648) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 23:47:26 devstack cinder-volume[86648]: DEBUG cinder.service [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86648) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 23:47:26 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 03 23:47:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:47:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:47:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:47:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:47:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:47:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:26 devstack sudo[86693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:47:26 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:27 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.679s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c974b59e-6017-473f-a095-7448ba0e0430 None None] Driver post RPC initialization completed successfully.
Jul 03 23:47:34 devstack cinder-volume[86324]: DEBUG dbcounter [-] [86324] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86324) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:47:36 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:47:37 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=3 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:48:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:48:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 6 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:48:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Flow 'volume_create_manager' (f98ace43-ec23-40e9-a2df-e26f0f6e8663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22b74ad-efbc-4f2b-b82f-ef438b48b7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f22b74ad-efbc-4f2b-b82f-ef438b48b7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-12658273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f993b950-a215-4647-9ae4-59837bb8d930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5ac000e74247ea8a070060c128443e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:48:25Z,use_quota=True,user_id='d1702d980c364c78a9a22c7543f34d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fd57ff-33a9-4cd4-a604-ec2085b6e673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fd57ff-33a9-4cd4-a604-ec2085b6e673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a955e3-f270-4d51-a808-efc442a9a464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a955e3-f270-4d51-a808-efc442a9a464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f993b950-a215-4647-9ae4-59837bb8d930', 'volume_name': 'volume-f993b950-a215-4647-9ae4-59837bb8d930', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b100aad2-9366-4f02-9670-8d963c3648f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b100aad2-9366-4f02-9670-8d963c3648f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be202de1-509e-47fa-a74c-43b36d60f903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:48:25 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Volume f993b950-a215-4647-9ae4-59837bb8d930: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f993b950-a215-4647-9ae4-59837bb8d930', 'volume_size': 1}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-12658273',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f993b950-a215-4647-9ae4-59837bb8d930,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5ac000e74247ea8a070060c128443e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:48:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:48:25Z,use_quota=True,user_id='d1702d980c364c78a9a22c7543f34d4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Creating volume f993b950-a215-4647-9ae4-59837bb8d930 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:48:25 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:48:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:48:25 devstack sudo[87040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930 1073741824
Jul 03 23:48:25 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:48:26 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root
Jul 03 23:48:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930 1073741824" returned: 0 in 1.567s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:48:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:48:27 devstack sudo[87375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930
Jul 03 23:48:27 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:48:28 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root
Jul 03 23:48:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930" returned: 0 in 1.394s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:48:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] <== create_volume: return (3061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:48:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.066s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:48:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be202de1-509e-47fa-a74c-43b36d60f903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f993b950-a215-4647-9ae4-59837bb8d930', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:48:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f862f104-281f-402b-a0ae-2f2151a50375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:48:28 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Volume volume-f993b950-a215-4647-9ae4-59837bb8d930 (f993b950-a215-4647-9ae4-59837bb8d930): created successfully
Jul 03 23:48:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f862f104-281f-402b-a0ae-2f2151a50375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:48:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Flow 'volume_create_manager' (f98ace43-ec23-40e9-a2df-e26f0f6e8663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:48:28 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8ab7a135-e819-4ac2-ac75-5054bd91feee tempest-TaggedAttachmentsTest-396803534 None] Created volume successfully.
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Flow 'volume_create_manager' (88fdc3ae-6ac4-4a13-8404-e937f963e629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084b33d5-9fa7-4653-8a6a-722850ed82b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (084b33d5-9fa7-4653-8a6a-722850ed82b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1939664431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82458ac6-7435-4241-9702-b65bd7db4c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35951159a5694e6d82b6a23f585cdff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:48:30Z,use_quota=True,user_id='54892dbd13184c9ca96b5381bb3c4f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a310804-f3d5-4a69-8d52-ed13f0580522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a310804-f3d5-4a69-8d52-ed13f0580522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183ae164-011c-4b2c-b757-ae4f61a60873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183ae164-011c-4b2c-b757-ae4f61a60873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82458ac6-7435-4241-9702-b65bd7db4c82', 'volume_name': 'volume-82458ac6-7435-4241-9702-b65bd7db4c82', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f3d553-7ce0-40fb-820b-4c2dffdcefe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f3d553-7ce0-40fb-820b-4c2dffdcefe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19fb449-fbf3-42a9-969d-1e8990afcbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:48:30 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Volume 82458ac6-7435-4241-9702-b65bd7db4c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82458ac6-7435-4241-9702-b65bd7db4c82', 'volume_size': 1}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:48:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1939664431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82458ac6-7435-4241-9702-b65bd7db4c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35951159a5694e6d82b6a23f585cdff1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:48:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:48:30Z,use_quota=True,user_id='54892dbd13184c9ca96b5381bb3c4f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Creating volume 82458ac6-7435-4241-9702-b65bd7db4c82 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:48:30 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:48:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:48:30 devstack sudo[87403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82 1073741824
Jul 03 23:48:30 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:48:32 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root
Jul 03 23:48:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82 1073741824" returned: 0 in 2.168s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:48:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:48:32 devstack sudo[87457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82
Jul 03 23:48:32 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:48:34 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root
Jul 03 23:48:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82" returned: 0 in 1.286s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:48:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] <== create_volume: return (3556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:48:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.561s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:48:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19fb449-fbf3-42a9-969d-1e8990afcbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82458ac6-7435-4241-9702-b65bd7db4c82', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:48:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322d0f61-766e-4b1f-ba40-16656314208f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:48:34 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Volume volume-82458ac6-7435-4241-9702-b65bd7db4c82 (82458ac6-7435-4241-9702-b65bd7db4c82): created successfully
Jul 03 23:48:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322d0f61-766e-4b1f-ba40-16656314208f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:48:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Flow 'volume_create_manager' (88fdc3ae-6ac4-4a13-8404-e937f963e629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:48:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-67c48d3b-6481-4dea-866a-8c2978e3e3dc tempest-DeleteServersTestJSON-1463123361 None] Created volume successfully.
Jul 03 23:48:44 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:48:44 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=7,cinder:DELETE=2,cinder:SELECT=2,cinder:INSERT=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:48:44 devstack cinder-volume[86648]: WARNING py.warnings [req-b5723ce7-2d93-4eed-9bc4-9eb60cd3532f req-27bc92fb-ed67-43fd-a71c-5cb83d490e43 tempest-DeleteServersTestJSON-1463123361 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jul 03 23:48:44 devstack cinder-volume[86648]:   .first()
Jul 03 23:48:44 devstack cinder-volume[86648]: 
Jul 03 23:48:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-b5723ce7-2d93-4eed-9bc4-9eb60cd3532f req-27bc92fb-ed67-43fd-a71c-5cb83d490e43 tempest-DeleteServersTestJSON-1463123361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:48:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-b5723ce7-2d93-4eed-9bc4-9eb60cd3532f req-27bc92fb-ed67-43fd-a71c-5cb83d490e43 tempest-DeleteServersTestJSON-1463123361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:48:44 devstack cinder-volume[86648]: INFO oslo.privsep.daemon [req-b5723ce7-2d93-4eed-9bc4-9eb60cd3532f req-27bc92fb-ed67-43fd-a71c-5cb83d490e43 tempest-DeleteServersTestJSON-1463123361 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpoj02kbu_/privsep.sock']
Jul 03 23:48:44 devstack sudo[87565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpoj02kbu_/privsep.sock
Jul 03 23:48:44 devstack sudo[87565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:48:46 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 03 23:48:46 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 23:48:46 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 03 23:48:46 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 23:48:46 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 03 23:48:46 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 03 23:48:46 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 23:48:46 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 23:48:46 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 03 23:48:47 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 03 23:48:47 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 23:48:47 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 03 23:48:47 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 23:48:47 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 03 23:48:47 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 03 23:48:47 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 23:48:47 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 23:48:47 devstack cinder-volume[86648]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 03 23:48:47 devstack sudo[87565]: pam_unix(sudo:session): session closed for user root
Jul 03 23:48:47 devstack cinder-volume[86648]: INFO oslo.privsep.daemon [req-b5723ce7-2d93-4eed-9bc4-9eb60cd3532f req-27bc92fb-ed67-43fd-a71c-5cb83d490e43 tempest-DeleteServersTestJSON-1463123361 None] Spawned new privsep daemon via rootwrap
Jul 03 23:48:47 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [req-b5723ce7-2d93-4eed-9bc4-9eb60cd3532f req-27bc92fb-ed67-43fd-a71c-5cb83d490e43 tempest-DeleteServersTestJSON-1463123361 None] Accepted privsep connection to /tmp/tmpoj02kbu_/privsep.sock {{(pid=86648) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 03 23:48:47 devstack cinder-volume[86648]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 03 23:48:47 devstack cinder-volume[86648]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 03 23:48:47 devstack cinder-volume[86648]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 03 23:48:47 devstack cinder-volume[86648]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87598
Jul 03 23:48:47 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0647ec-40c5-45c7-afff-8253a56b253c]: (2,) {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:48:47 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1300921-9939-452e-bbf8-d5bb53094918]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:48:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-b5723ce7-2d93-4eed-9bc4-9eb60cd3532f req-27bc92fb-ed67-43fd-a71c-5cb83d490e43 tempest-DeleteServersTestJSON-1463123361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:48:48 devstack sudo[87606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82
Jul 03 23:48:48 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:48:49 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root
Jul 03 23:48:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-b5723ce7-2d93-4eed-9bc4-9eb60cd3532f req-27bc92fb-ed67-43fd-a71c-5cb83d490e43 tempest-DeleteServersTestJSON-1463123361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82" returned: 0 in 1.193s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:48:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-b5723ce7-2d93-4eed-9bc4-9eb60cd3532f req-27bc92fb-ed67-43fd-a71c-5cb83d490e43 tempest-DeleteServersTestJSON-1463123361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.191s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:48:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-b5723ce7-2d93-4eed-9bc4-9eb60cd3532f req-27bc92fb-ed67-43fd-a71c-5cb83d490e43 tempest-DeleteServersTestJSON-1463123361 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-82458ac6-7435-4241-9702-b65bd7db4c82', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f22766a-f781-406b-8602-963ef42d4290', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:48:49 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-b5723ce7-2d93-4eed-9bc4-9eb60cd3532f req-27bc92fb-ed67-43fd-a71c-5cb83d490e43 tempest-DeleteServersTestJSON-1463123361 None] attachment_update completed successfully.
Jul 03 23:48:59 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:48:59 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:49:00 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-c7c25e8a-295c-4468-8266-696ee42b1448 req-2cff4bfe-71d6-43bf-be35-5bd50216c6ba tempest-DeleteServersTestJSON-1463123361 None] Terminate volume connection completed successfully.
Jul 03 23:49:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-c7c25e8a-295c-4468-8266-696ee42b1448 req-2cff4bfe-71d6-43bf-be35-5bd50216c6ba tempest-DeleteServersTestJSON-1463123361 None] Deleting attachment 9f22766a-f781-406b-8602-963ef42d4290. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:49:04 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:49:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Flow 'volume_create_manager' (626452aa-82f7-4739-9a06-62a6014cc988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:49:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d1e637-8781-4772-b769-6d1f24d102ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Acquiring lock "cinder-82458ac6-7435-4241-9702-b65bd7db4c82-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d1e637-8781-4772-b769-6d1f24d102ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1353289658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30074788-8b41-4098-b61b-7c8645b554c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b46b83d39f24a7f8c7d5b602eb09f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:05Z,use_quota=True,user_id='44bbac9e16514417b400271653f64cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988ee878-3497-4781-8cf5-32c2d0877a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (988ee878-3497-4781-8cf5-32c2d0877a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5268d30d-b7f8-4112-8af9-be394289722b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5268d30d-b7f8-4112-8af9-be394289722b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30074788-8b41-4098-b61b-7c8645b554c3', 'volume_name': 'volume-30074788-8b41-4098-b61b-7c8645b554c3', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b234d187-3ce7-4371-8275-a4beb2b8ff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b234d187-3ce7-4371-8275-a4beb2b8ff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5a8d3c-64c1-4cd5-ba48-8917648d41e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:05 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Volume 30074788-8b41-4098-b61b-7c8645b554c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30074788-8b41-4098-b61b-7c8645b554c3', 'volume_size': 1}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1353289658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30074788-8b41-4098-b61b-7c8645b554c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b46b83d39f24a7f8c7d5b602eb09f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:05Z,use_quota=True,user_id='44bbac9e16514417b400271653f64cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Creating volume 30074788-8b41-4098-b61b-7c8645b554c3 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:49:05 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:05 devstack sudo[88213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3 1073741824
Jul 03 23:49:05 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Lock "cinder-82458ac6-7435-4241-9702-b65bd7db4c82-delete_volume" acquired by "delete_volume" :: waited 0.132s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:49:05 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:49:05 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Acquiring lock "cinder-quobyte-82458ac6-7435-4241-9702-b65bd7db4c82" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Lock "cinder-quobyte-82458ac6-7435-4241-9702-b65bd7db4c82" acquired by "delete_volume" :: waited 0.034s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1d4502-88f9-437c-9ab0-04d2f4b95fe7]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:49:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:05 devstack sudo[88219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82
Jul 03 23:49:05 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:05 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.907s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:06 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:49:06 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:49:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 8 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:49:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:49:06 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3 1073741824" returned: 0 in 1.154s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:06 devstack sudo[88226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3
Jul 03 23:49:06 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:06 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82" returned: 0 in 1.394s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:06 devstack sudo[88232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82
Jul 03 23:49:06 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:07 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3" returned: 0 in 0.855s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5a8d3c-64c1-4cd5-ba48-8917648d41e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30074788-8b41-4098-b61b-7c8645b554c3', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c514df89-a9b9-495b-b4dd-39c080cbec73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:07 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Volume volume-30074788-8b41-4098-b61b-7c8645b554c3 (30074788-8b41-4098-b61b-7c8645b554c3): created successfully
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c514df89-a9b9-495b-b4dd-39c080cbec73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Flow 'volume_create_manager' (626452aa-82f7-4739-9a06-62a6014cc988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:49:07 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1b79db88-518c-422f-b3c8-2cb489be13da tempest-AttachVolumeNegativeTest-1274739212 None] Created volume successfully.
Jul 03 23:49:07 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-82458ac6-7435-4241-9702-b65bd7db4c82" returned: 0 in 0.787s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Lock "cinder-quobyte-82458ac6-7435-4241-9702-b65bd7db4c82" released by "delete_volume" :: held 2.257s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:49:07 devstack cinder-volume[86648]: WARNING cinder.quota [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:49:07 devstack cinder-volume[86648]: WARNING cinder.quota [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Created reservations ['4cf2fa82-0770-4ea3-9a9a-e691f3ed68f0', '182714cc-0ea8-42fa-95df-0ddd6d936aad', '6706cc31-9948-4329-83ad-63b0fc9fdd16', 'e8d596b3-0e2c-4c1e-9ee9-ebf77a0f1c4f'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:07 devstack sudo[88236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:49:07 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:08 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.699s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:08 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:49:08 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Deleted volume successfully.
Jul 03 23:49:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-63956e0b-ee96-40c6-a459-faff208a32be tempest-DeleteServersTestJSON-1463123361 None] Lock "cinder-82458ac6-7435-4241-9702-b65bd7db4c82-delete_volume" released by "delete_volume" :: held 3.346s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:49:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-72390f24-bfce-4bd9-b05d-d3c2abbb5fce req-5faa531f-4da2-4a8a-a67d-405cb8e622b6 tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-72390f24-bfce-4bd9-b05d-d3c2abbb5fce req-5faa531f-4da2-4a8a-a67d-405cb8e622b6 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:11 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ca40e4-9b63-464d-9b95-ea57ebce675d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:49:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-72390f24-bfce-4bd9-b05d-d3c2abbb5fce req-5faa531f-4da2-4a8a-a67d-405cb8e622b6 tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:11 devstack sudo[88276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3
Jul 03 23:49:11 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:12 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-72390f24-bfce-4bd9-b05d-d3c2abbb5fce req-5faa531f-4da2-4a8a-a67d-405cb8e622b6 tempest-AttachVolumeNegativeTest-1274739212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3" returned: 0 in 1.023s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-72390f24-bfce-4bd9-b05d-d3c2abbb5fce req-5faa531f-4da2-4a8a-a67d-405cb8e622b6 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.040s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-72390f24-bfce-4bd9-b05d-d3c2abbb5fce req-5faa531f-4da2-4a8a-a67d-405cb8e622b6 tempest-AttachVolumeNegativeTest-1274739212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-30074788-8b41-4098-b61b-7c8645b554c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b716270-85bd-44bc-8b1e-042efcb8b5d2', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:49:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-72390f24-bfce-4bd9-b05d-d3c2abbb5fce req-5faa531f-4da2-4a8a-a67d-405cb8e622b6 tempest-AttachVolumeNegativeTest-1274739212 None] attachment_update completed successfully.
Jul 03 23:49:22 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=13,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:49:22 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=14,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:49:37 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:49:37 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:49:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-098a8421-64e9-4d59-b22f-f1b8e30dffd4 req-0cbc5d27-c844-4821-9833-6d0282f0cae5 tempest-TaggedAttachmentsTest-396803534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-098a8421-64e9-4d59-b22f-f1b8e30dffd4 req-0cbc5d27-c844-4821-9833-6d0282f0cae5 tempest-TaggedAttachmentsTest-396803534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:41 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a7f90b-c34a-4ac6-add9-703f23ef1fed]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:49:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-098a8421-64e9-4d59-b22f-f1b8e30dffd4 req-0cbc5d27-c844-4821-9833-6d0282f0cae5 tempest-TaggedAttachmentsTest-396803534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:41 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930
Jul 03 23:49:41 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:42 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-098a8421-64e9-4d59-b22f-f1b8e30dffd4 req-0cbc5d27-c844-4821-9833-6d0282f0cae5 tempest-TaggedAttachmentsTest-396803534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930" returned: 0 in 0.871s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-098a8421-64e9-4d59-b22f-f1b8e30dffd4 req-0cbc5d27-c844-4821-9833-6d0282f0cae5 tempest-TaggedAttachmentsTest-396803534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.912s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-098a8421-64e9-4d59-b22f-f1b8e30dffd4 req-0cbc5d27-c844-4821-9833-6d0282f0cae5 tempest-TaggedAttachmentsTest-396803534 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-f993b950-a215-4647-9ae4-59837bb8d930', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5f002af-e9f3-4fcf-b897-95ed5684f7f8', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:49:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-098a8421-64e9-4d59-b22f-f1b8e30dffd4 req-0cbc5d27-c844-4821-9833-6d0282f0cae5 tempest-TaggedAttachmentsTest-396803534 None] attachment_update completed successfully.
Jul 03 23:49:49 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-fd686d68-e182-4ad0-903c-b2ea436b8583 req-8b31dbeb-59b8-4965-af11-e979c613c7d9 tempest-TaggedAttachmentsTest-396803534 None] Terminate volume connection completed successfully.
Jul 03 23:49:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-fd686d68-e182-4ad0-903c-b2ea436b8583 req-8b31dbeb-59b8-4965-af11-e979c613c7d9 tempest-TaggedAttachmentsTest-396803534 None] Deleting attachment f5f002af-e9f3-4fcf-b897-95ed5684f7f8. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:49:59 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:49:59 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:50:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:50:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:05 devstack sudo[89193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:50:05 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:07 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 2.156s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:07 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:50:07 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:50:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 8 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:50:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Flow 'volume_create_manager' (13b95dfc-958b-4b10-a4b7-741fa30d431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3d3a63-5b81-4b13-af10-18ecc6ee5acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3d3a63-5b81-4b13-af10-18ecc6ee5acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1810680304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249c8509fca44e5086d4759f581c16f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:50:09Z,use_quota=True,user_id='d77bb9834ea448b9b22f2155509f16fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18010060-548d-49ae-b5bf-18c3ad01d688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18010060-548d-49ae-b5bf-18c3ad01d688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6545fea-2ce9-40b7-a350-4efb5030b179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6545fea-2ce9-40b7-a350-4efb5030b179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1', 'volume_name': 'volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9df2295-fcf4-438e-a859-40788f81ffbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9df2295-fcf4-438e-a859-40788f81ffbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d28516-7a13-4edd-9f76-ca295b79c328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:09 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Volume 5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1', 'volume_size': 1}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1810680304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='249c8509fca44e5086d4759f581c16f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:50:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:50:09Z,use_quota=True,user_id='d77bb9834ea448b9b22f2155509f16fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Creating volume 5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:50:09 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:50:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:09 devstack sudo[89243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1 1073741824
Jul 03 23:50:09 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:11 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1 1073741824" returned: 0 in 1.784s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:11 devstack sudo[89264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1
Jul 03 23:50:11 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:12 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1" returned: 0 in 1.372s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] <== create_volume: return (3266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:50:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.270s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d28516-7a13-4edd-9f76-ca295b79c328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd5edc7-da4f-41fa-9858-1bf6a0fbb3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:12 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Volume volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1 (5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1): created successfully
Jul 03 23:50:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fd5edc7-da4f-41fa-9858-1bf6a0fbb3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Flow 'volume_create_manager' (13b95dfc-958b-4b10-a4b7-741fa30d431c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:50:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8d84a63e-cc8c-4334-93ff-a6c179d0a14e tempest-VolumesAdminNegativeTest-1252462240 None] Created volume successfully.
Jul 03 23:50:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Acquiring lock "cinder-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Lock "cinder-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Acquiring lock "cinder-quobyte-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Lock "cinder-quobyte-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:14 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55affd7-2881-45ca-9ffc-d43905373e5b]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:14 devstack sudo[89292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1
Jul 03 23:50:14 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Acquiring lock "cinder-f993b950-a215-4647-9ae4-59837bb8d930-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Lock "cinder-f993b950-a215-4647-9ae4-59837bb8d930-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Acquiring lock "cinder-quobyte-f993b950-a215-4647-9ae4-59837bb8d930" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Lock "cinder-quobyte-f993b950-a215-4647-9ae4-59837bb8d930" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:16 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1" returned: 0 in 1.724s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:16 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab87374c-e57c-429a-8238-4d4a65f82bbb]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:16 devstack sudo[89298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1
Jul 03 23:50:16 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:16 devstack sudo[89299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930
Jul 03 23:50:16 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:16 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1" returned: 0 in 0.745s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Lock "cinder-quobyte-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1" released by "delete_volume" :: held 2.553s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:16 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Created reservations ['b9c296b6-c7df-4d26-8178-b4f82a37f56b', '6908e40b-c214-4937-9fa4-532d25233747', '48242ce2-2921-4425-a89b-48d01f758ab9', '5258d9f7-0df9-45fb-a069-db7eb83057fb'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:50:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:17 devstack sudo[89322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:50:17 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:17 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930" returned: 0 in 1.148s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:17 devstack sudo[89324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930
Jul 03 23:50:17 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:18 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f993b950-a215-4647-9ae4-59837bb8d930" returned: 0 in 1.511s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:18 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Lock "cinder-quobyte-f993b950-a215-4647-9ae4-59837bb8d930" released by "delete_volume" :: held 2.757s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:18 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.687s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:18 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:50:18 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Deleted volume successfully.
Jul 03 23:50:19 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Created reservations ['eafad349-65ee-4031-be03-0849f91e61cc', 'bc3a3fd3-943e-4dc4-916a-17c8b667f3fc', '096e15ec-c664-4eb3-8af1-97d9af563198', '27df3f69-e5b5-4355-bab7-932a4c92ef67'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:50:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-052dd14c-d3ee-41ec-b5c0-e6057697f8ac tempest-VolumesAdminNegativeTest-1252462240 None] Lock "cinder-5bc14bc1-c95c-4b2d-b79a-9b96e32b5fc1-delete_volume" released by "delete_volume" :: held 4.864s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:19 devstack sudo[89359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:50:19 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:20 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.631s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:20 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:50:20 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Deleted volume successfully.
Jul 03 23:50:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1e6d892a-34c9-4022-9f79-49e3570a61b8 tempest-TaggedAttachmentsTest-396803534 None] Lock "cinder-f993b950-a215-4647-9ae4-59837bb8d930-delete_volume" released by "delete_volume" :: held 5.002s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:29 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=18,cinder:INSERT=3,cinder:SELECT=13,cinder:DELETE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:50:30 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=11,cinder:UPDATE=20,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:50:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-0f6a73b1-6bfc-490c-8062-e72e1f2a4bda req-0a95125f-ec1f-4ae6-b180-3688535c8045 tempest-AttachVolumeNegativeTest-1274739212 None] Terminate volume connection completed successfully.
Jul 03 23:50:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-0f6a73b1-6bfc-490c-8062-e72e1f2a4bda req-0a95125f-ec1f-4ae6-b180-3688535c8045 tempest-AttachVolumeNegativeTest-1274739212 None] Deleting attachment 7b716270-85bd-44bc-8b1e-042efcb8b5d2. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Flow 'volume_create_manager' (9c4041ae-b078-4d63-9bcb-a740fcc77cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f86c1a-0036-446a-b0a6-cda0dc8c7ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f86c1a-0036-446a-b0a6-cda0dc8c7ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-53852275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa6ea1b-7356-47c3-b055-63af6d885526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88dc5dd192e041f19b844fea0ab64e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:50:36Z,use_quota=True,user_id='5d2601f1647742ec97fcc1de55475d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2206b2ac-bf31-4420-8e25-09ddbb702c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2206b2ac-bf31-4420-8e25-09ddbb702c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad52d07-dd81-4364-a39e-b10860c83f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad52d07-dd81-4364-a39e-b10860c83f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa6ea1b-7356-47c3-b055-63af6d885526', 'volume_name': 'volume-9fa6ea1b-7356-47c3-b055-63af6d885526', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54106f52-506a-44f6-8d0c-774dad3670d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54106f52-506a-44f6-8d0c-774dad3670d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf4f590-1635-46a4-92d0-ed01c33aec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:36 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Volume 9fa6ea1b-7356-47c3-b055-63af6d885526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa6ea1b-7356-47c3-b055-63af6d885526', 'volume_size': 1}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-53852275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa6ea1b-7356-47c3-b055-63af6d885526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88dc5dd192e041f19b844fea0ab64e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:50:36Z,use_quota=True,user_id='5d2601f1647742ec97fcc1de55475d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Creating volume 9fa6ea1b-7356-47c3-b055-63af6d885526 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:50:36 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:50:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9fa6ea1b-7356-47c3-b055-63af6d885526 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:36 devstack sudo[89480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9fa6ea1b-7356-47c3-b055-63af6d885526 1073741824
Jul 03 23:50:36 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:37 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9fa6ea1b-7356-47c3-b055-63af6d885526 1073741824" returned: 0 in 1.045s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9fa6ea1b-7356-47c3-b055-63af6d885526 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:37 devstack sudo[89487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9fa6ea1b-7356-47c3-b055-63af6d885526
Jul 03 23:50:37 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:38 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9fa6ea1b-7356-47c3-b055-63af6d885526" returned: 0 in 0.922s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:50:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf4f590-1635-46a4-92d0-ed01c33aec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa6ea1b-7356-47c3-b055-63af6d885526', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7366906b-9bbd-4494-a4f3-0288df57fd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:38 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Volume volume-9fa6ea1b-7356-47c3-b055-63af6d885526 (9fa6ea1b-7356-47c3-b055-63af6d885526): created successfully
Jul 03 23:50:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7366906b-9bbd-4494-a4f3-0288df57fd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Flow 'volume_create_manager' (9c4041ae-b078-4d63-9bcb-a740fcc77cf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:50:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-17228f53-b6e0-48cb-93d0-755a20b6cd65 tempest-ServersNegativeTestJSON-944428044 None] Created volume successfully.
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Flow 'volume_create_manager' (b27c8b27-cd63-4e39-849d-c6a724681c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d064ebd2-3d69-4fd6-a0ef-5af08f022299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d064ebd2-3d69-4fd6-a0ef-5af08f022299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1019640580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff029a33-5466-4101-958b-9e2bd8afd748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88dc5dd192e041f19b844fea0ab64e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:50:45Z,use_quota=True,user_id='5d2601f1647742ec97fcc1de55475d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f882095b-4865-4a70-8d0a-c1f912d4eb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f882095b-4865-4a70-8d0a-c1f912d4eb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16798a3-4caf-4f5c-a5c1-963fb736420e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a16798a3-4caf-4f5c-a5c1-963fb736420e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff029a33-5466-4101-958b-9e2bd8afd748', 'volume_name': 'volume-ff029a33-5466-4101-958b-9e2bd8afd748', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1739344-d3ea-4e68-8139-88305aa1e02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1739344-d3ea-4e68-8139-88305aa1e02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50908ddd-00c5-4dd3-80c1-51217add418b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:45 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Volume ff029a33-5466-4101-958b-9e2bd8afd748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff029a33-5466-4101-958b-9e2bd8afd748', 'volume_size': 1}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1019640580',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff029a33-5466-4101-958b-9e2bd8afd748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88dc5dd192e041f19b844fea0ab64e33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:50:45Z,use_quota=True,user_id='5d2601f1647742ec97fcc1de55475d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Creating volume ff029a33-5466-4101-958b-9e2bd8afd748 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:50:45 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:50:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ff029a33-5466-4101-958b-9e2bd8afd748 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:45 devstack sudo[89520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ff029a33-5466-4101-958b-9e2bd8afd748 1073741824
Jul 03 23:50:45 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:46 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ff029a33-5466-4101-958b-9e2bd8afd748 1073741824" returned: 0 in 1.165s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ff029a33-5466-4101-958b-9e2bd8afd748 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:46 devstack sudo[89529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ff029a33-5466-4101-958b-9e2bd8afd748
Jul 03 23:50:46 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:47 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ff029a33-5466-4101-958b-9e2bd8afd748" returned: 0 in 1.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] <== create_volume: return (2257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:50:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.259s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50908ddd-00c5-4dd3-80c1-51217add418b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff029a33-5466-4101-958b-9e2bd8afd748', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d6f429-536b-47da-b32e-04e583f5704d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:47 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Volume volume-ff029a33-5466-4101-958b-9e2bd8afd748 (ff029a33-5466-4101-958b-9e2bd8afd748): created successfully
Jul 03 23:50:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d6f429-536b-47da-b32e-04e583f5704d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Flow 'volume_create_manager' (b27c8b27-cd63-4e39-849d-c6a724681c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:50:47 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2852a17c-6ab8-4c48-a220-779deafc7926 tempest-ServersNegativeTestJSON-944428044 None] Created volume successfully.
Jul 03 23:50:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Acquiring lock "cinder-ff029a33-5466-4101-958b-9e2bd8afd748-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Lock "cinder-ff029a33-5466-4101-958b-9e2bd8afd748-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Acquiring lock "cinder-quobyte-ff029a33-5466-4101-958b-9e2bd8afd748" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Lock "cinder-quobyte-ff029a33-5466-4101-958b-9e2bd8afd748" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:49 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e256bd57-b121-4ae9-930d-e1aa896c4332]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ff029a33-5466-4101-958b-9e2bd8afd748 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:49 devstack sudo[89532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ff029a33-5466-4101-958b-9e2bd8afd748
Jul 03 23:50:49 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:50 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ff029a33-5466-4101-958b-9e2bd8afd748" returned: 0 in 1.130s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ff029a33-5466-4101-958b-9e2bd8afd748 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:50 devstack sudo[89538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ff029a33-5466-4101-958b-9e2bd8afd748
Jul 03 23:50:50 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:51 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ff029a33-5466-4101-958b-9e2bd8afd748" returned: 0 in 0.815s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Lock "cinder-quobyte-ff029a33-5466-4101-958b-9e2bd8afd748" released by "delete_volume" :: held 2.026s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:51 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Created reservations ['c57115d8-1dcc-4344-bb54-05a6522b2aac', 'e5b1c1c2-7442-481c-97a9-eb3f2002895d', 'c5849c8f-e4cf-4d78-a5ad-f6830764b17b', '245bb208-cc6f-4a2b-b63b-1d7feb3f4242'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:50:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:51 devstack sudo[89541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:50:51 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Acquiring lock "cinder-9fa6ea1b-7356-47c3-b055-63af6d885526-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Lock "cinder-9fa6ea1b-7356-47c3-b055-63af6d885526-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Acquiring lock "cinder-quobyte-9fa6ea1b-7356-47c3-b055-63af6d885526" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Lock "cinder-quobyte-9fa6ea1b-7356-47c3-b055-63af6d885526" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:52 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c91cac3-0284-4822-873b-98e9863abb79]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9fa6ea1b-7356-47c3-b055-63af6d885526 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:52 devstack sudo[89543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9fa6ea1b-7356-47c3-b055-63af6d885526
Jul 03 23:50:52 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:52 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.887s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:52 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:50:52 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Deleted volume successfully.
Jul 03 23:50:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-653a0633-bccf-4cd6-af64-38955c4cf321 tempest-ServersNegativeTestJSON-944428044 None] Lock "cinder-ff029a33-5466-4101-958b-9e2bd8afd748-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:53 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9fa6ea1b-7356-47c3-b055-63af6d885526" returned: 0 in 0.949s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9fa6ea1b-7356-47c3-b055-63af6d885526 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:53 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9fa6ea1b-7356-47c3-b055-63af6d885526
Jul 03 23:50:53 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:53 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9fa6ea1b-7356-47c3-b055-63af6d885526" returned: 0 in 0.845s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Lock "cinder-quobyte-9fa6ea1b-7356-47c3-b055-63af6d885526" released by "delete_volume" :: held 1.843s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:53 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Created reservations ['b87a93b2-2de5-45af-9f6a-5eb27e2a1a28', 'db148a1b-4a9f-4f7d-b74c-6848a17bfe54', '269db1a2-627f-4716-b8a1-153618c995b7', 'f4ddf214-35cd-486d-9b6c-fedbf89e2c82'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:50:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:54 devstack sudo[89556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:50:54 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:55 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.047s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:55 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:50:55 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Deleted volume successfully.
Jul 03 23:50:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e67c939c-9457-4371-b44f-b83f6a529aed tempest-ServersNegativeTestJSON-944428044 None] Lock "cinder-9fa6ea1b-7356-47c3-b055-63af6d885526-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:51:04 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=14,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:51:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:51:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:05 devstack sudo[89670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:51:05 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:05 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=16,cinder:UPDATE=23,cinder:INSERT=4,cinder:DELETE=3 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:51:06 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.921s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:06 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:51:06 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:51:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 8 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:51:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:51:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-086f6590-f1b1-4043-a7cd-88abe3cd295e tempest-GroupsTest-638882099 None] Group tempest-Group1-1823053038: creating
Jul 03 23:51:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-086f6590-f1b1-4043-a7cd-88abe3cd295e tempest-GroupsTest-638882099 None] Group tempest-Group1-1823053038: created successfully
Jul 03 23:51:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-086f6590-f1b1-4043-a7cd-88abe3cd295e tempest-GroupsTest-638882099 None] Create group completed successfully.
Jul 03 23:51:35 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9cbd3e3c-5b11-464d-a2fe-38c75183dad9 tempest-GroupsTest-638882099 None] Group tempest-Group2-489234428: creating
Jul 03 23:51:35 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9cbd3e3c-5b11-464d-a2fe-38c75183dad9 tempest-GroupsTest-638882099 None] Group tempest-Group2-489234428: created successfully
Jul 03 23:51:35 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9cbd3e3c-5b11-464d-a2fe-38c75183dad9 tempest-GroupsTest-638882099 None] Create group completed successfully.
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Flow 'volume_create_manager' (11f0c526-2235-4c64-b8af-a6e3a2c7f624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f7e8a2-1141-4704-a690-a68478dc7b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f7e8a2-1141-4704-a690-a68478dc7b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-171141812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=45af07d3-d2b0-40a1-8448-50d13555b126,host='devstack@QuobyteHD#QuobyteHD',id=8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aba625163e3d4fc1b1615ddca494659b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:37Z,use_quota=True,user_id='d0d47c2401c7437f86e6a7499ee440e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d425124c-5ac7-45a8-8e2b-c0fc67bbc640),volume_type_id=d425124c-5ac7-45a8-8e2b-c0fc67bbc640)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361d5ce0-19e0-4338-b3e9-cfe9cb2c58a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (361d5ce0-19e0-4338-b3e9-cfe9cb2c58a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3355b54-f245-4650-beac-feb3edd59250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3355b54-f245-4650-beac-feb3edd59250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1', 'volume_name': 'volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da64b342-9ec9-40cc-ad78-f157c7989c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da64b342-9ec9-40cc-ad78-f157c7989c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c11cf6-673f-4d65-85b7-dc847b4d66e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:37 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Volume 8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1', 'volume_size': 1}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=45af07d3-d2b0-40a1-8448-50d13555b126,created_at=2026-07-03T21:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-171141812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=45af07d3-d2b0-40a1-8448-50d13555b126,host='devstack@QuobyteHD#QuobyteHD',id=8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aba625163e3d4fc1b1615ddca494659b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:37Z,use_quota=True,user_id='d0d47c2401c7437f86e6a7499ee440e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d425124c-5ac7-45a8-8e2b-c0fc67bbc640),volume_type_id=d425124c-5ac7-45a8-8e2b-c0fc67bbc640)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Creating volume 8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:51:37 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:51:37 devstack sudo[90003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1 1073741824
Jul 03 23:51:37 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Flow 'volume_create_manager' (e9c80b05-9ff7-45bf-a384-be078a166628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a97d3f-c430-4a0f-ab4f-a42a6b1b2885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a97d3f-c430-4a0f-ab4f-a42a6b1b2885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2036972071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735b4175-3d72-4abb-bce4-6e2aebdd0dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b46b83d39f24a7f8c7d5b602eb09f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:37Z,use_quota=True,user_id='44bbac9e16514417b400271653f64cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab73769-c229-429b-8562-7d90f406089a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab73769-c229-429b-8562-7d90f406089a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65de2989-da0e-45c1-9fe7-f4039c3f6e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65de2989-da0e-45c1-9fe7-f4039c3f6e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '735b4175-3d72-4abb-bce4-6e2aebdd0dae', 'volume_name': 'volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a12dff5-7359-476d-a820-fdf8578a0fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a12dff5-7359-476d-a820-fdf8578a0fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d390d0b-ec24-4610-85d5-dba05a8b6163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:37 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Volume 735b4175-3d72-4abb-bce4-6e2aebdd0dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae', 'volume_size': 1}
Jul 03 23:51:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:38 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1 1073741824" returned: 0 in 0.819s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:38 devstack sudo[90009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1
Jul 03 23:51:38 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:39 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1" returned: 0 in 0.660s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.409s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2036972071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=735b4175-3d72-4abb-bce4-6e2aebdd0dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b46b83d39f24a7f8c7d5b602eb09f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:37Z,use_quota=True,user_id='44bbac9e16514417b400271653f64cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Creating volume 735b4175-3d72-4abb-bce4-6e2aebdd0dae {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:51:39 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:39 devstack sudo[90012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae 1073741824
Jul 03 23:51:39 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c11cf6-673f-4d65-85b7-dc847b4d66e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6be935-1105-4204-830b-2846200e547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:39 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Volume volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1 (8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1): created successfully
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b6be935-1105-4204-830b-2846200e547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Flow 'volume_create_manager' (11f0c526-2235-4c64-b8af-a6e3a2c7f624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0743ff6b-f1d5-437a-b5be-541dee547c16 tempest-GroupsTest-638882099 None] Created volume successfully.
Jul 03 23:51:39 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae 1073741824" returned: 0 in 0.858s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:40 devstack sudo[90019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae
Jul 03 23:51:40 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Acquiring lock "cinder-quobyte-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:51:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Lock "cinder-quobyte-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:51:40 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8291882-6880-403b-8f4b-9b1de9b74366]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:40 devstack sudo[90027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1
Jul 03 23:51:40 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:40 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae" returned: 0 in 0.867s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:51:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d390d0b-ec24-4610-85d5-dba05a8b6163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86d0f6b-c9b1-4f23-9072-1ee69cd8805d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:40 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Volume volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae (735b4175-3d72-4abb-bce4-6e2aebdd0dae): created successfully
Jul 03 23:51:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b86d0f6b-c9b1-4f23-9072-1ee69cd8805d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Flow 'volume_create_manager' (e9c80b05-9ff7-45bf-a384-be078a166628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:40 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2f3d1274-9016-4fcf-bd9f-656731d43ebb tempest-AttachVolumeNegativeTest-1274739212 None] Created volume successfully.
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Flow 'volume_create_manager' (4fe299c1-ce04-4dcb-855a-d5b40cf0b9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f25a1f3-5103-4c54-960c-253820d12acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f25a1f3-5103-4c54-960c-253820d12acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1044527750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1639d49-2d2c-4ab7-9756-a6977ba09c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105f5d27fc054f929e79df608d428648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:41Z,use_quota=True,user_id='a9cd52b3602b49ec934157cd4a1f8a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c87f415-7886-4247-aee8-6d9a79668523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c87f415-7886-4247-aee8-6d9a79668523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e00a964-0883-4c20-a19b-73d4f71040e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e00a964-0883-4c20-a19b-73d4f71040e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1639d49-2d2c-4ab7-9756-a6977ba09c6e', 'volume_name': 'volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515cc006-b870-4b72-9253-ffe50be3cb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515cc006-b870-4b72-9253-ffe50be3cb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ee863e-c008-4a80-a3f0-56d6e1c86781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:41 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Volume b1639d49-2d2c-4ab7-9756-a6977ba09c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e', 'volume_size': 1}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1044527750',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1639d49-2d2c-4ab7-9756-a6977ba09c6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105f5d27fc054f929e79df608d428648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:41Z,use_quota=True,user_id='a9cd52b3602b49ec934157cd4a1f8a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Creating volume b1639d49-2d2c-4ab7-9756-a6977ba09c6e {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:51:41 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:41 devstack sudo[90030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e 1073741824
Jul 03 23:51:41 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:41 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1" returned: 0 in 0.992s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:41 devstack sudo[90062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1
Jul 03 23:51:41 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:42 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1" returned: 0 in 0.765s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:42 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e 1073741824" returned: 0 in 1.008s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Lock "cinder-quobyte-8b0c7b4e-5439-4aae-9c86-3c2a1d9899b1" released by "delete_volume" :: held 1.811s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:51:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:42 devstack sudo[90072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e
Jul 03 23:51:42 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:42 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Created reservations ['44404da0-e936-4e9e-8f33-363450406c85'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:51:42 devstack cinder-volume[86648]: WARNING cinder.quota [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1898571131 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1898571131, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:51:42 devstack cinder-volume[86648]: WARNING cinder.quota [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1898571131 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1898571131, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:51:42 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Created reservations ['12072da5-7da4-42f5-89c2-e9601bf91e9b', '7b6b75de-51c1-4421-8cb2-1b095ae21217', '49620962-c9ef-4e9a-ba41-6708a58c8d59', '43a56aea-b030-4d47-a959-54f5a3bfc925'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:51:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:42 devstack sudo[90074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:51:42 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:43 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e" returned: 0 in 0.690s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ee863e-c008-4a80-a3f0-56d6e1c86781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8661f37e-ebf2-48a7-adb6-fa3d02501979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-2749fe02-d7fb-483a-98f1-b90cd28a3afb tempest-GroupsTest-638882099 None] Created reservations ['6557a90c-6cdf-43f8-8d56-919a3d6c1a21'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:51:43 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Volume volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e (b1639d49-2d2c-4ab7-9756-a6977ba09c6e): created successfully
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8661f37e-ebf2-48a7-adb6-fa3d02501979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Flow 'volume_create_manager' (4fe299c1-ce04-4dcb-855a-d5b40cf0b9cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:43 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-29dcf2df-0e4b-4e61-ac83-13b7f364ff92 tempest-AttachVolumeTestJSON-1926062192 None] Created volume successfully.
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2749fe02-d7fb-483a-98f1-b90cd28a3afb tempest-GroupsTest-638882099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2749fe02-d7fb-483a-98f1-b90cd28a3afb tempest-GroupsTest-638882099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2749fe02-d7fb-483a-98f1-b90cd28a3afb tempest-GroupsTest-638882099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2749fe02-d7fb-483a-98f1-b90cd28a3afb tempest-GroupsTest-638882099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2749fe02-d7fb-483a-98f1-b90cd28a3afb tempest-GroupsTest-638882099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2749fe02-d7fb-483a-98f1-b90cd28a3afb tempest-GroupsTest-638882099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:43 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:51:43 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:43 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.693s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:43 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:51:43 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f48c27c3-e0cc-45a0-b37b-ab6fcddaee78 tempest-GroupsTest-638882099 None] Delete group completed successfully.
Jul 03 23:51:44 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2749fe02-d7fb-483a-98f1-b90cd28a3afb tempest-GroupsTest-638882099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.724s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:44 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-2749fe02-d7fb-483a-98f1-b90cd28a3afb tempest-GroupsTest-638882099 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:51:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2749fe02-d7fb-483a-98f1-b90cd28a3afb tempest-GroupsTest-638882099 None] Delete group completed successfully.
Jul 03 23:51:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-bf5f3726-b4d3-4242-896a-902bcbca659d req-6cbd1a05-6c21-446e-931e-136caa22ec8c tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-bf5f3726-b4d3-4242-896a-902bcbca659d req-6cbd1a05-6c21-446e-931e-136caa22ec8c tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:44 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bd2834-96b9-4d59-b788-bab26fef883f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-bf5f3726-b4d3-4242-896a-902bcbca659d req-6cbd1a05-6c21-446e-931e-136caa22ec8c tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ab640f67-64df-4641-a316-0c8eb770da4f tempest-GroupsTest-638882099 None] Group tempest-GroupsTest-Group-1622531238: creating
Jul 03 23:51:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ab640f67-64df-4641-a316-0c8eb770da4f tempest-GroupsTest-638882099 None] Group tempest-GroupsTest-Group-1622531238: created successfully
Jul 03 23:51:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ab640f67-64df-4641-a316-0c8eb770da4f tempest-GroupsTest-638882099 None] Create group completed successfully.
Jul 03 23:51:44 devstack sudo[90094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae
Jul 03 23:51:44 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:45 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-bf5f3726-b4d3-4242-896a-902bcbca659d req-6cbd1a05-6c21-446e-931e-136caa22ec8c tempest-AttachVolumeNegativeTest-1274739212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae" returned: 0 in 0.780s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-bf5f3726-b4d3-4242-896a-902bcbca659d req-6cbd1a05-6c21-446e-931e-136caa22ec8c tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.801s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-bf5f3726-b4d3-4242-896a-902bcbca659d req-6cbd1a05-6c21-446e-931e-136caa22ec8c tempest-AttachVolumeNegativeTest-1274739212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5add7086-d280-473e-8a91-8808379c5d18', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:51:45 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-bf5f3726-b4d3-4242-896a-902bcbca659d req-6cbd1a05-6c21-446e-931e-136caa22ec8c tempest-AttachVolumeNegativeTest-1274739212 None] attachment_update completed successfully.
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-b1e4b786-3212-4bce-abfa-dec93d8040e5 req-95c5ba72-c483-4216-a42b-911fee135347 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-b1e4b786-3212-4bce-abfa-dec93d8040e5 req-95c5ba72-c483-4216-a42b-911fee135347 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Flow 'volume_create_manager' (ca6dcb36-b182-4f7d-b7c7-f8bc61a63cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed04ed6-c806-480f-971d-05b9a382b868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff23e6c-aeae-4849-94e4-5e1cf225515f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-b1e4b786-3212-4bce-abfa-dec93d8040e5 req-95c5ba72-c483-4216-a42b-911fee135347 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed04ed6-c806-480f-971d-05b9a382b868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2120750368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a7a8cad-b5e5-40f2-b67a-7b69ba72f33d,host='devstack@QuobyteHD#QuobyteHD',id=2cb0c9e0-b488-4d09-9128-44116e9b00bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aba625163e3d4fc1b1615ddca494659b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:46Z,use_quota=True,user_id='d0d47c2401c7437f86e6a7499ee440e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b3b3885-e98f-491e-a39e-3b90557408b2),volume_type_id=3b3b3885-e98f-491e-a39e-3b90557408b2)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdfc6b3-aeec-4b12-9833-08fe0c1c5a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdfc6b3-aeec-4b12-9833-08fe0c1c5a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a49220-c5c3-4412-b46a-d3649c81d210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a49220-c5c3-4412-b46a-d3649c81d210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cb0c9e0-b488-4d09-9128-44116e9b00bc', 'volume_name': 'volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4c70f4-86d7-4b25-a8e2-b4ec4101b8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4c70f4-86d7-4b25-a8e2-b4ec4101b8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4401bbaa-a2d4-4371-b57c-3af0f43dd4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:46 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Volume 2cb0c9e0-b488-4d09-9128-44116e9b00bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc', 'volume_size': 1}
Jul 03 23:51:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:46 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e
Jul 03 23:51:46 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:47 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-b1e4b786-3212-4bce-abfa-dec93d8040e5 req-95c5ba72-c483-4216-a42b-911fee135347 tempest-AttachVolumeTestJSON-1926062192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e" returned: 0 in 0.762s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-b1e4b786-3212-4bce-abfa-dec93d8040e5 req-95c5ba72-c483-4216-a42b-911fee135347 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.809s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.695s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5a7a8cad-b5e5-40f2-b67a-7b69ba72f33d,created_at=2026-07-03T21:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2120750368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a7a8cad-b5e5-40f2-b67a-7b69ba72f33d,host='devstack@QuobyteHD#QuobyteHD',id=2cb0c9e0-b488-4d09-9128-44116e9b00bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aba625163e3d4fc1b1615ddca494659b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:46Z,use_quota=True,user_id='d0d47c2401c7437f86e6a7499ee440e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b3b3885-e98f-491e-a39e-3b90557408b2),volume_type_id=3b3b3885-e98f-491e-a39e-3b90557408b2)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Creating volume 2cb0c9e0-b488-4d09-9128-44116e9b00bc {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:51:47 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:47 devstack sudo[90496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc 1073741824
Jul 03 23:51:47 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-b1e4b786-3212-4bce-abfa-dec93d8040e5 req-95c5ba72-c483-4216-a42b-911fee135347 tempest-AttachVolumeTestJSON-1926062192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9a63909-387f-484d-bb2e-7ebaabe730f9', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:51:47 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-b1e4b786-3212-4bce-abfa-dec93d8040e5 req-95c5ba72-c483-4216-a42b-911fee135347 tempest-AttachVolumeTestJSON-1926062192 None] attachment_update completed successfully.
Jul 03 23:51:48 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc 1073741824" returned: 0 in 0.894s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:48 devstack sudo[90504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc
Jul 03 23:51:48 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:48 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc" returned: 0 in 0.655s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:51:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4401bbaa-a2d4-4371-b57c-3af0f43dd4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0538cf-eeff-4931-b0a6-26ab5dfded35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:48 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Volume volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc (2cb0c9e0-b488-4d09-9128-44116e9b00bc): created successfully
Jul 03 23:51:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0538cf-eeff-4931-b0a6-26ab5dfded35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Flow 'volume_create_manager' (ca6dcb36-b182-4f7d-b7c7-f8bc61a63cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:49 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-607f788f-2cfe-43bd-bc11-df4c5ab49885 tempest-GroupsTest-638882099 None] Created volume successfully.
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Flow 'volume_create_manager' (edd581a6-8062-4064-ac7d-c41586830844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb8fc5f-ef88-4291-a11d-4ebb58dd50c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebb8fc5f-ef88-4291-a11d-4ebb58dd50c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368179689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a7a8cad-b5e5-40f2-b67a-7b69ba72f33d,host='devstack@QuobyteHD#QuobyteHD',id=5c3fabd4-4744-49e0-84b2-eece3273a913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aba625163e3d4fc1b1615ddca494659b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:51Z,use_quota=True,user_id='d0d47c2401c7437f86e6a7499ee440e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b3b3885-e98f-491e-a39e-3b90557408b2),volume_type_id=3b3b3885-e98f-491e-a39e-3b90557408b2)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7af7781-79c8-4dc5-8bd0-dd699fe5f98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7af7781-79c8-4dc5-8bd0-dd699fe5f98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79c94a9-63e9-42c0-b790-e0ceab99f38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79c94a9-63e9-42c0-b790-e0ceab99f38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3fabd4-4744-49e0-84b2-eece3273a913', 'volume_name': 'volume-5c3fabd4-4744-49e0-84b2-eece3273a913', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58e9527-6a41-479f-91af-71848867f018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e58e9527-6a41-479f-91af-71848867f018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310b231b-6734-47ca-b78e-586abf87ce15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:50 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Volume 5c3fabd4-4744-49e0-84b2-eece3273a913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3fabd4-4744-49e0-84b2-eece3273a913', 'volume_size': 1}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5a7a8cad-b5e5-40f2-b67a-7b69ba72f33d,created_at=2026-07-03T21:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368179689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a7a8cad-b5e5-40f2-b67a-7b69ba72f33d,host='devstack@QuobyteHD#QuobyteHD',id=5c3fabd4-4744-49e0-84b2-eece3273a913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aba625163e3d4fc1b1615ddca494659b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:51Z,use_quota=True,user_id='d0d47c2401c7437f86e6a7499ee440e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b3b3885-e98f-491e-a39e-3b90557408b2),volume_type_id=3b3b3885-e98f-491e-a39e-3b90557408b2)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Creating volume 5c3fabd4-4744-49e0-84b2-eece3273a913 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:51:51 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:51:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5c3fabd4-4744-49e0-84b2-eece3273a913 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:51 devstack sudo[90509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5c3fabd4-4744-49e0-84b2-eece3273a913 1073741824
Jul 03 23:51:51 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:51 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5c3fabd4-4744-49e0-84b2-eece3273a913 1073741824" returned: 0 in 0.940s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5c3fabd4-4744-49e0-84b2-eece3273a913 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:52 devstack sudo[90516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5c3fabd4-4744-49e0-84b2-eece3273a913
Jul 03 23:51:52 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:52 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-95eb3804-598d-452a-8b44-22b35d4383c3 req-7ad40e3f-580f-417a-a036-099cad0132df tempest-AttachVolumeNegativeTest-1274739212 None] Terminate volume connection completed successfully.
Jul 03 23:51:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-95eb3804-598d-452a-8b44-22b35d4383c3 req-7ad40e3f-580f-417a-a036-099cad0132df tempest-AttachVolumeNegativeTest-1274739212 None] Deleting attachment 5add7086-d280-473e-8a91-8808379c5d18. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:51:52 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5c3fabd4-4744-49e0-84b2-eece3273a913" returned: 0 in 0.662s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:51:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310b231b-6734-47ca-b78e-586abf87ce15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3fabd4-4744-49e0-84b2-eece3273a913', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dae78e-4450-4816-9a0d-4aa463c84e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:52 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Volume volume-5c3fabd4-4744-49e0-84b2-eece3273a913 (5c3fabd4-4744-49e0-84b2-eece3273a913): created successfully
Jul 03 23:51:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dae78e-4450-4816-9a0d-4aa463c84e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Flow 'volume_create_manager' (edd581a6-8062-4064-ac7d-c41586830844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:52 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d995737e-7dc6-45ed-860f-378ffbbb2e4f tempest-GroupsTest-638882099 None] Created volume successfully.
Jul 03 23:51:53 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a9cecc96-7b90-4e25-a3de-67fa57898b99 tempest-GroupsTest-638882099 None] Update group completed successfully.
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Flow 'volume_create_manager' (5d409d2d-7a76-4563-a56b-5f38e362adc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe2f091-ba16-4f27-9f9d-8fe59df4ff6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe2f091-ba16-4f27-9f9d-8fe59df4ff6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-755240972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9879dabcf9a4531b61b57879b06b8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:54Z,use_quota=True,user_id='c097985fc94b40e586d1f748335cf455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979b5ec0-8b61-40c8-9875-f7b1018d4104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979b5ec0-8b61-40c8-9875-f7b1018d4104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b891a477-cb2a-4ce0-bc7f-30149d8bd043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b891a477-cb2a-4ce0-bc7f-30149d8bd043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d', 'volume_name': 'volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbed55de-41ed-489b-b88f-1cf922954e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbed55de-41ed-489b-b88f-1cf922954e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4129b8c9-011c-436f-a734-2bb29d70bab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:53 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Volume 0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d', 'volume_size': 1}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-755240972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9879dabcf9a4531b61b57879b06b8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:54Z,use_quota=True,user_id='c097985fc94b40e586d1f748335cf455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Creating volume 0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:51:54 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:51:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:54 devstack sudo[90529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d 1073741824
Jul 03 23:51:54 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:55 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d 1073741824" returned: 0 in 1.147s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:55 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-26c5c553-21fb-4ded-b90d-122ae2088c5d tempest-GroupsTest-638882099 None] Update group completed successfully.
Jul 03 23:51:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:55 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d
Jul 03 23:51:55 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:56 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d" returned: 0 in 0.808s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:51:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4129b8c9-011c-436f-a734-2bb29d70bab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbe1f5d-7dba-4ccb-abe6-ee2a9d4469d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:56 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Volume volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d (0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d): created successfully
Jul 03 23:51:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acbe1f5d-7dba-4ccb-abe6-ee2a9d4469d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Flow 'volume_create_manager' (5d409d2d-7a76-4563-a56b-5f38e362adc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:56 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-3fcf81d3-ce01-4aa3-a8d8-8be7e815559a tempest-ServerActionsTestOtherA-1656019275 None] Created volume successfully.
Jul 03 23:51:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Acquiring lock "cinder-quobyte-2cb0c9e0-b488-4d09-9128-44116e9b00bc" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:51:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Lock "cinder-quobyte-2cb0c9e0-b488-4d09-9128-44116e9b00bc" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:51:57 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe6798-de34-43c1-82a1-504784dce156]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:57 devstack sudo[90562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc
Jul 03 23:51:57 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:58 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc" returned: 0 in 1.088s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:58 devstack sudo[90570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc
Jul 03 23:51:58 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:59 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2cb0c9e0-b488-4d09-9128-44116e9b00bc" returned: 0 in 0.861s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Lock "cinder-quobyte-2cb0c9e0-b488-4d09-9128-44116e9b00bc" released by "delete_volume" :: held 2.032s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:51:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Acquiring lock "cinder-quobyte-5c3fabd4-4744-49e0-84b2-eece3273a913" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:51:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Lock "cinder-quobyte-5c3fabd4-4744-49e0-84b2-eece3273a913" acquired by "delete_volume" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:51:59 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a302ec21-8328-4b10-96a6-0b79a330904c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5c3fabd4-4744-49e0-84b2-eece3273a913 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:59 devstack sudo[90578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5c3fabd4-4744-49e0-84b2-eece3273a913
Jul 03 23:51:59 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:00 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5c3fabd4-4744-49e0-84b2-eece3273a913" returned: 0 in 0.955s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5c3fabd4-4744-49e0-84b2-eece3273a913 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:00 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5c3fabd4-4744-49e0-84b2-eece3273a913
Jul 03 23:52:00 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:00 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5c3fabd4-4744-49e0-84b2-eece3273a913" returned: 0 in 0.727s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Lock "cinder-quobyte-5c3fabd4-4744-49e0-84b2-eece3273a913" released by "delete_volume" :: held 1.725s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:00 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Created reservations ['57125834-c45e-4250-a612-11c33af903cd'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:00 devstack cinder-volume[86648]: WARNING cinder.quota [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1956030269 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1956030269, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:52:00 devstack cinder-volume[86648]: WARNING cinder.quota [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1956030269 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1956030269, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:52:00 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Created reservations ['5d667eec-4c9e-4f72-9d23-54d6d8da5d94', '927c62de-66d4-4ece-affd-261c54ad3e65', '662cf9f8-1b63-4ec8-8e55-a75340e2af9d', '3a094ae0-5009-44a0-9d43-30e822e8673c'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:01 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Created reservations ['3e8cabca-b742-4723-8f9b-ae15b8c40075', '08cc21a8-bde0-44dc-ae4d-081148b34264', '5151f0e4-e91a-4194-88c2-c1bba04c50f3', 'c645b0dc-f1bf-410a-848d-f6cb146ae2fa'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:01 devstack sudo[90630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:52:01 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:02 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.876s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:02 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:52:02 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-331713a7-9982-4d15-bee5-56525662d147 tempest-GroupsTest-638882099 None] Delete group completed successfully.
Jul 03 23:52:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:52:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:05 devstack sudo[90771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:52:05 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:06 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.456s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:06 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:52:06 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:52:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 8 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:52:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:52:11 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=59,cinder:UPDATE=54,cinder:INSERT=11,cinder:DELETE=4 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:52:11 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=62,cinder:SELECT=60,cinder:DELETE=2,cinder:INSERT=10 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Flow 'volume_create_manager' (746b24e1-4bb7-4b0b-b37a-893c40975840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b566f5fd-96dc-44ed-8046-a4a0aeca5cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b566f5fd-96dc-44ed-8046-a4a0aeca5cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2039311831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406ace00-22a0-4139-b65d-b112de64d869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5d8074308b47c4894a428d4de96e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:31Z,use_quota=True,user_id='dc822d54a4a04beeb1fbeb775dbf723e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d88a95a-7996-496a-9fe8-de856f2f99c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d88a95a-7996-496a-9fe8-de856f2f99c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1099d013-3162-4a7e-acec-371e758a2ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1099d013-3162-4a7e-acec-371e758a2ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406ace00-22a0-4139-b65d-b112de64d869', 'volume_name': 'volume-406ace00-22a0-4139-b65d-b112de64d869', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05627c61-b5e7-42bc-955c-4d0b19b1bbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05627c61-b5e7-42bc-955c-4d0b19b1bbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e2de52-a6e9-4b28-9c1f-390710aa0049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:30 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Volume 406ace00-22a0-4139-b65d-b112de64d869: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406ace00-22a0-4139-b65d-b112de64d869', 'volume_size': 1}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2039311831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406ace00-22a0-4139-b65d-b112de64d869,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d5d8074308b47c4894a428d4de96e35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:31Z,use_quota=True,user_id='dc822d54a4a04beeb1fbeb775dbf723e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Creating volume 406ace00-22a0-4139-b65d-b112de64d869 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:52:30 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:52:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:30 devstack sudo[91390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869 1073741824
Jul 03 23:52:30 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:31 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869 1073741824" returned: 0 in 0.980s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:31 devstack sudo[91397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869
Jul 03 23:52:31 devstack sudo[91397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-63c3c933-fa5e-4e5b-b077-0aa176b5724a req-811e49a9-3a67-45f4-b1bb-ddfb2f2215ac tempest-AttachVolumeTestJSON-1926062192 None] Terminate volume connection completed successfully.
Jul 03 23:52:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-63c3c933-fa5e-4e5b-b077-0aa176b5724a req-811e49a9-3a67-45f4-b1bb-ddfb2f2215ac tempest-AttachVolumeTestJSON-1926062192 None] Deleting attachment b9a63909-387f-484d-bb2e-7ebaabe730f9. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:52:32 devstack sudo[91397]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869" returned: 0 in 0.881s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:52:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3e2de52-a6e9-4b28-9c1f-390710aa0049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406ace00-22a0-4139-b65d-b112de64d869', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1617066c-8ff2-4e2d-b84a-8dd3f9b4ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:32 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Volume volume-406ace00-22a0-4139-b65d-b112de64d869 (406ace00-22a0-4139-b65d-b112de64d869): created successfully
Jul 03 23:52:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1617066c-8ff2-4e2d-b84a-8dd3f9b4ba91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Flow 'volume_create_manager' (746b24e1-4bb7-4b0b-b37a-893c40975840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8d0c2e46-bd11-4400-9fe3-4dc03f3fb950 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Created volume successfully.
Jul 03 23:52:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Creating offline snapshot b624e78b-b591-499c-9969-ccca521ddf65 of volume 406ace00-22a0-4139-b65d-b112de64d869 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:52:33 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2f5ed5-8056-4df8-93f5-b7df88e11e67]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:34 devstack sudo[91405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869
Jul 03 23:52:34 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:34 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869" returned: 0 in 0.804s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:34 devstack sudo[91411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65 1G
Jul 03 23:52:34 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:35 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65 1G" returned: 0 in 0.875s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406ace00-22a0-4139-b65d-b112de64d869 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:35 devstack sudo[91420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406ace00-22a0-4139-b65d-b112de64d869 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65
Jul 03 23:52:35 devstack sudo[91420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:36 devstack sudo[91420]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-406ace00-22a0-4139-b65d-b112de64d869 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65" returned: 0 in 0.984s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:36 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65 is being set with open permissions: ugo+rw
Jul 03 23:52:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:36 devstack sudo[91426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65
Jul 03 23:52:36 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:37 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65" returned: 0 in 0.735s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:37 devstack sudo[91429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.info
Jul 03 23:52:37 devstack sudo[91429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:38 devstack sudo[91429]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.info" returned: 0 in 0.892s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:38 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.info is being set with open permissions: ugo+rw
Jul 03 23:52:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:38 devstack sudo[91432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.info
Jul 03 23:52:38 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:39 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.info" returned: 0 in 0.850s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.232s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-88343d32-6a9d-4ed2-a322-fd2b1b521420 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Create snapshot completed successfully
Jul 03 23:52:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Acquiring lock "cinder-b624e78b-b591-499c-9969-ccca521ddf65-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "cinder-b624e78b-b591-499c-9969-ccca521ddf65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Acquiring lock "cinder-quobyte-406ace00-22a0-4139-b65d-b112de64d869" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "cinder-quobyte-406ace00-22a0-4139-b65d-b112de64d869" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Acquiring lock "cinder-quobyte-b624e78b-b591-499c-9969-ccca521ddf65" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "cinder-quobyte-b624e78b-b591-499c-9969-ccca521ddf65" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Deleting offline snapshot b624e78b-b591-499c-9969-ccca521ddf65 of volume 406ace00-22a0-4139-b65d-b112de64d869 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:52:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] snapshot_file for this snap is: volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:52:40 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5743399-4b0f-490b-82e6-7a691ae6487a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:41 devstack sudo[91451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65
Jul 03 23:52:41 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:42 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65" returned: 0 in 1.178s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-406ace00-22a0-4139-b65d-b112de64d869(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:52:42 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e066e4-0bb6-4367-8308-a49c395c53cd]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:42 devstack sudo[91476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869
Jul 03 23:52:42 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:42 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869" returned: 0 in 0.791s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:42 devstack sudo[91489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65
Jul 03 23:52:42 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:43 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65" returned: 0 in 0.758s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:43 devstack sudo[91501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65
Jul 03 23:52:43 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:44 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869.b624e78b-b591-499c-9969-ccca521ddf65" returned: 0 in 1.034s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "cinder-quobyte-b624e78b-b591-499c-9969-ccca521ddf65" released by "_delete_snapshot" :: held 3.941s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "cinder-quobyte-406ace00-22a0-4139-b65d-b112de64d869" released by "delete_snapshot" :: held 3.976s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:44 devstack cinder-volume[86648]: WARNING cinder.quota [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:52:44 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Created reservations ['5450d1c2-6c6f-4c05-b1d2-80e1990248e4', '940e0db7-f294-4282-9c27-5a19dd57f6c9', 'd6df4ee5-254d-46d1-bdc9-b9a9c9fbc215', 'ae6107d4-9cca-4331-97d5-dae6425b9f4a'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:45 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Delete snapshot completed successfully.
Jul 03 23:52:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c485863d-a085-4d7d-9a9e-dd6537c98e4f tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "cinder-b624e78b-b591-499c-9969-ccca521ddf65-delete_snapshot" released by "delete_snapshot" :: held 4.193s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Acquiring lock "cinder-406ace00-22a0-4139-b65d-b112de64d869-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "cinder-406ace00-22a0-4139-b65d-b112de64d869-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Acquiring lock "cinder-quobyte-406ace00-22a0-4139-b65d-b112de64d869" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "cinder-quobyte-406ace00-22a0-4139-b65d-b112de64d869" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:45 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d205ba62-94db-4aab-89a3-766d6ec3f1da]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-f37df57d-25a0-45b9-9e8d-14faef6c74d8 req-8ea83b70-1707-4202-9fd4-6554579f8b69 tempest-ServerActionsTestOtherA-1656019275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-f37df57d-25a0-45b9-9e8d-14faef6c74d8 req-8ea83b70-1707-4202-9fd4-6554579f8b69 tempest-ServerActionsTestOtherA-1656019275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:45 devstack sudo[91577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869
Jul 03 23:52:45 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:45 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9d6c4c-4626-4f5f-880b-f61dd45bcd85]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-f37df57d-25a0-45b9-9e8d-14faef6c74d8 req-8ea83b70-1707-4202-9fd4-6554579f8b69 tempest-ServerActionsTestOtherA-1656019275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:45 devstack sudo[91579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d
Jul 03 23:52:45 devstack sudo[91579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:46 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869" returned: 0 in 0.911s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:46 devstack sudo[91587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869
Jul 03 23:52:46 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:46 devstack sudo[91579]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-f37df57d-25a0-45b9-9e8d-14faef6c74d8 req-8ea83b70-1707-4202-9fd4-6554579f8b69 tempest-ServerActionsTestOtherA-1656019275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d" returned: 0 in 0.957s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-f37df57d-25a0-45b9-9e8d-14faef6c74d8 req-8ea83b70-1707-4202-9fd4-6554579f8b69 tempest-ServerActionsTestOtherA-1656019275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.984s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-f37df57d-25a0-45b9-9e8d-14faef6c74d8 req-8ea83b70-1707-4202-9fd4-6554579f8b69 tempest-ServerActionsTestOtherA-1656019275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db15d662-d795-4297-91ac-ec6fd20f6684', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:52:46 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-f37df57d-25a0-45b9-9e8d-14faef6c74d8 req-8ea83b70-1707-4202-9fd4-6554579f8b69 tempest-ServerActionsTestOtherA-1656019275 None] attachment_update completed successfully.
Jul 03 23:52:47 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406ace00-22a0-4139-b65d-b112de64d869" returned: 0 in 0.707s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "cinder-quobyte-406ace00-22a0-4139-b65d-b112de64d869" released by "delete_volume" :: held 1.709s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:47 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Created reservations ['04affae0-86d5-426b-bf88-b702d2e9cc95', '09560943-4d6b-44c4-8eef-2ce837fc947a', '0265c046-4a7c-42c5-8e31-fe65c595c6dc', '4722ff73-cac6-482a-9148-30944199907e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:47 devstack sudo[91657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:52:47 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:48 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.050s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:48 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:52:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Deleted volume successfully.
Jul 03 23:52:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-60039c79-b3c3-4391-8442-0d0fb35aee81 tempest-VolumeSnapshotQuotasNegativeTestJSON-371798398 None] Lock "cinder-406ace00-22a0-4139-b65d-b112de64d869-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Flow 'volume_create_manager' (1fbea8e8-3ae3-4f93-be58-c526ba6be3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e242fa-1107-4bfb-b7b4-c06f261cc7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e242fa-1107-4bfb-b7b4-c06f261cc7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1493693690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093f6869-3eba-42ac-b11a-ae49e8d16c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b46b83d39f24a7f8c7d5b602eb09f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:53Z,use_quota=True,user_id='44bbac9e16514417b400271653f64cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8ebfed-0cfc-434d-b6d4-7cd015f06944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8ebfed-0cfc-434d-b6d4-7cd015f06944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fd1d14-86ae-4241-97db-4d28cf829962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fd1d14-86ae-4241-97db-4d28cf829962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '093f6869-3eba-42ac-b11a-ae49e8d16c69', 'volume_name': 'volume-093f6869-3eba-42ac-b11a-ae49e8d16c69', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4bd5401-9c46-4074-a9da-497bbd5a1618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4bd5401-9c46-4074-a9da-497bbd5a1618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0c2448-cc33-4a26-91bd-1872f6bf743a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:52 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Volume 093f6869-3eba-42ac-b11a-ae49e8d16c69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-093f6869-3eba-42ac-b11a-ae49e8d16c69', 'volume_size': 1}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1493693690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093f6869-3eba-42ac-b11a-ae49e8d16c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b46b83d39f24a7f8c7d5b602eb09f65',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:53Z,use_quota=True,user_id='44bbac9e16514417b400271653f64cc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Creating volume 093f6869-3eba-42ac-b11a-ae49e8d16c69 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:52:52 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:52:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:52 devstack sudo[91995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69 1073741824
Jul 03 23:52:52 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:54 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69 1073741824" returned: 0 in 1.307s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:54 devstack sudo[92004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69
Jul 03 23:52:54 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:54 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69" returned: 0 in 0.770s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:52:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0c2448-cc33-4a26-91bd-1872f6bf743a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093f6869-3eba-42ac-b11a-ae49e8d16c69', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5022ba0a-9b4f-4d8f-b514-60ed2754f611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:54 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Volume volume-093f6869-3eba-42ac-b11a-ae49e8d16c69 (093f6869-3eba-42ac-b11a-ae49e8d16c69): created successfully
Jul 03 23:52:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5022ba0a-9b4f-4d8f-b514-60ed2754f611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Flow 'volume_create_manager' (1fbea8e8-3ae3-4f93-be58-c526ba6be3db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:54 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-88ba1721-c7f9-45b3-94a7-86e79a83110c tempest-AttachVolumeNegativeTest-1274739212 None] Created volume successfully.
Jul 03 23:52:56 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-13e22bc5-76c7-4cfa-9db1-223f0665c1c5 req-ac7deb6f-af9f-4118-80e7-f971d5e67eed tempest-ServerActionsTestOtherA-1656019275 None] Terminate volume connection completed successfully.
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-13e22bc5-76c7-4cfa-9db1-223f0665c1c5 req-ac7deb6f-af9f-4118-80e7-f971d5e67eed tempest-ServerActionsTestOtherA-1656019275 None] Deleting attachment db15d662-d795-4297-91ac-ec6fd20f6684. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Flow 'volume_create_manager' (4e0bd29e-53ba-49a3-854d-1ac3a0a51ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c02150-44b7-4948-91eb-02b16afa4340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c02150-44b7-4948-91eb-02b16afa4340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1518905588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91991e33-7375-4cfc-b50b-4a99e56c7fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20cfb564e17e476da8425b990275e5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:56Z,use_quota=True,user_id='0c3caf82e89444d393fe2aace713db81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3beb0e92-b3b2-4107-94cf-537f43d904d7),volume_type_id=3beb0e92-b3b2-4107-94cf-537f43d904d7)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07921bc4-1a31-45cc-a332-65404c53d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07921bc4-1a31-45cc-a332-65404c53d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bd7632-34ed-4d38-be6c-225f84704bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59bd7632-34ed-4d38-be6c-225f84704bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91991e33-7375-4cfc-b50b-4a99e56c7fb1', 'volume_name': 'volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea2504d-98c1-461a-a741-eec17aea778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea2504d-98c1-461a-a741-eec17aea778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fc8add-779c-4c9d-9c9d-4daa1a96dac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:56 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Volume 91991e33-7375-4cfc-b50b-4a99e56c7fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1', 'volume_size': 1}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1518905588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91991e33-7375-4cfc-b50b-4a99e56c7fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20cfb564e17e476da8425b990275e5a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:56Z,use_quota=True,user_id='0c3caf82e89444d393fe2aace713db81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3beb0e92-b3b2-4107-94cf-537f43d904d7),volume_type_id=3beb0e92-b3b2-4107-94cf-537f43d904d7)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Creating volume 91991e33-7375-4cfc-b50b-4a99e56c7fb1 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:52:56 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:52:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:56 devstack sudo[92043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1 1073741824
Jul 03 23:52:56 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:57 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1 1073741824" returned: 0 in 0.869s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:57 devstack sudo[92048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1
Jul 03 23:52:57 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:58 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1" returned: 0 in 0.921s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:52:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20fc8add-779c-4c9d-9c9d-4daa1a96dac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e073cd5d-bc5d-42e3-90e9-937b3664c36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:58 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Volume volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1 (91991e33-7375-4cfc-b50b-4a99e56c7fb1): created successfully
Jul 03 23:52:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e073cd5d-bc5d-42e3-90e9-937b3664c36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Flow 'volume_create_manager' (4e0bd29e-53ba-49a3-854d-1ac3a0a51ef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:58 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-39b1f843-42b8-451e-9a5f-017da97aa0a0 tempest-VolumeTypesAccessTest-207589895 None] Created volume successfully.
Jul 03 23:52:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-13e22bc5-76c7-4cfa-9db1-223f0665c1c5 req-ef1d3957-3c5e-4ad5-b6e0-a270a4541976 tempest-ServerActionsTestOtherA-1656019275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-13e22bc5-76c7-4cfa-9db1-223f0665c1c5 req-ef1d3957-3c5e-4ad5-b6e0-a270a4541976 tempest-ServerActionsTestOtherA-1656019275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[806ac7e0-c5f7-45d5-8a5a-125a56aa75a7]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-13e22bc5-76c7-4cfa-9db1-223f0665c1c5 req-ef1d3957-3c5e-4ad5-b6e0-a270a4541976 tempest-ServerActionsTestOtherA-1656019275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:58 devstack sudo[92083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d
Jul 03 23:52:58 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-1f48e05c-35d3-4267-b8d8-e3be0968babf req-38c73c3c-b3ab-4f18-bd52-710f1862f611 tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:59 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-13e22bc5-76c7-4cfa-9db1-223f0665c1c5 req-ef1d3957-3c5e-4ad5-b6e0-a270a4541976 tempest-ServerActionsTestOtherA-1656019275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d" returned: 0 in 0.801s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-13e22bc5-76c7-4cfa-9db1-223f0665c1c5 req-ef1d3957-3c5e-4ad5-b6e0-a270a4541976 tempest-ServerActionsTestOtherA-1656019275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.817s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-1f48e05c-35d3-4267-b8d8-e3be0968babf req-38c73c3c-b3ab-4f18-bd52-710f1862f611 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.145s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f92f86-2520-41fc-b64e-140a400c76a3]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-1f48e05c-35d3-4267-b8d8-e3be0968babf req-38c73c3c-b3ab-4f18-bd52-710f1862f611 tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-13e22bc5-76c7-4cfa-9db1-223f0665c1c5 req-ef1d3957-3c5e-4ad5-b6e0-a270a4541976 tempest-ServerActionsTestOtherA-1656019275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24f714e1-dcd6-4610-92f5-2b31023f97a2', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:52:59 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-13e22bc5-76c7-4cfa-9db1-223f0665c1c5 req-ef1d3957-3c5e-4ad5-b6e0-a270a4541976 tempest-ServerActionsTestOtherA-1656019275 None] attachment_update completed successfully.
Jul 03 23:52:59 devstack sudo[92096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69
Jul 03 23:52:59 devstack sudo[92096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Acquiring lock "cinder-91991e33-7375-4cfc-b50b-4a99e56c7fb1-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Lock "cinder-91991e33-7375-4cfc-b50b-4a99e56c7fb1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Acquiring lock "cinder-quobyte-91991e33-7375-4cfc-b50b-4a99e56c7fb1" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Lock "cinder-quobyte-91991e33-7375-4cfc-b50b-4a99e56c7fb1" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d27c19-3146-452b-843a-9d780b5078cc]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:00 devstack sudo[92099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1
Jul 03 23:53:00 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:00 devstack sudo[92096]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-1f48e05c-35d3-4267-b8d8-e3be0968babf req-38c73c3c-b3ab-4f18-bd52-710f1862f611 tempest-AttachVolumeNegativeTest-1274739212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69" returned: 0 in 0.822s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-1f48e05c-35d3-4267-b8d8-e3be0968babf req-38c73c3c-b3ab-4f18-bd52-710f1862f611 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-1f48e05c-35d3-4267-b8d8-e3be0968babf req-38c73c3c-b3ab-4f18-bd52-710f1862f611 tempest-AttachVolumeNegativeTest-1274739212 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-093f6869-3eba-42ac-b11a-ae49e8d16c69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08b61b58-ba8e-4e46-9e3b-493e046673bc', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:53:00 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-1f48e05c-35d3-4267-b8d8-e3be0968babf req-38c73c3c-b3ab-4f18-bd52-710f1862f611 tempest-AttachVolumeNegativeTest-1274739212 None] attachment_update completed successfully.
Jul 03 23:53:00 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1" returned: 0 in 0.834s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:00 devstack sudo[92107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1
Jul 03 23:53:00 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:01 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91991e33-7375-4cfc-b50b-4a99e56c7fb1" returned: 0 in 0.720s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Lock "cinder-quobyte-91991e33-7375-4cfc-b50b-4a99e56c7fb1" released by "delete_volume" :: held 1.603s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:01 devstack cinder-volume[86648]: WARNING cinder.quota [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2134820434 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2134820434, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:53:01 devstack cinder-volume[86648]: WARNING cinder.quota [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2134820434 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2134820434, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:53:01 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Created reservations ['3e976078-5ee4-4062-9ed0-1f26f5caadd4', '1870c2d4-b688-48b0-923c-73419e594ae5', 'ba5984ac-2356-43d6-bca1-f9ecbba9b37c', '7bf6308b-e24e-4f55-9bc8-98fabba903ad'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:53:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:01 devstack sudo[92501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:53:01 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:02 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.797s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:02 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:02 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Deleted volume successfully.
Jul 03 23:53:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-88c8fe0d-d012-4098-9741-6a3e9f9a7600 tempest-VolumeTypesAccessTest-207589895 None] Lock "cinder-91991e33-7375-4cfc-b50b-4a99e56c7fb1-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:53:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:05 devstack sudo[92590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:53:05 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:06 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.066s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:06 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:08 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-1ab5243f-8b1e-48a8-b57b-d6a82101b24f req-c18e0aa7-5bb3-4e80-8438-ebb719ef7f33 tempest-AttachVolumeNegativeTest-1274739212 None] Terminate volume connection completed successfully.
Jul 03 23:53:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-1ab5243f-8b1e-48a8-b57b-d6a82101b24f req-c18e0aa7-5bb3-4e80-8438-ebb719ef7f33 tempest-AttachVolumeNegativeTest-1274739212 None] Deleting attachment 08b61b58-ba8e-4e46-9e3b-493e046673bc. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Flow 'volume_create_manager' (a37c3a65-0140-4846-9501-e0e1e86f2477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32219d76-cf18-4569-9d0e-5a5361b00acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32219d76-cf18-4569-9d0e-5a5361b00acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-31715974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30146a7c-61dd-4d27-ac70-2adee9ebe3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3031e6af65364f79b5c1ce0661260beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:11Z,use_quota=True,user_id='a8db78227557446f9bb417bca5158b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d8b873-7311-47e9-95e2-53a917527797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d8b873-7311-47e9-95e2-53a917527797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28003ab-0a7c-4701-8103-2ad348a7950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28003ab-0a7c-4701-8103-2ad348a7950c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30146a7c-61dd-4d27-ac70-2adee9ebe3d6', 'volume_name': 'volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eacd647-8ecc-437a-be00-508f18ed479f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eacd647-8ecc-437a-be00-508f18ed479f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fb33bc-ae7c-483a-91a5-f77521c0205c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:11 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Volume 30146a7c-61dd-4d27-ac70-2adee9ebe3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6', 'volume_size': 1}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-31715974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30146a7c-61dd-4d27-ac70-2adee9ebe3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3031e6af65364f79b5c1ce0661260beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:11Z,use_quota=True,user_id='a8db78227557446f9bb417bca5158b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Creating volume 30146a7c-61dd-4d27-ac70-2adee9ebe3d6 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:53:11 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:53:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:11 devstack sudo[92629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6 1073741824
Jul 03 23:53:11 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:12 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6 1073741824" returned: 0 in 1.553s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:13 devstack sudo[92651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6
Jul 03 23:53:13 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:14 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6" returned: 0 in 1.184s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] <== create_volume: return (2833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:53:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.838s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80fb33bc-ae7c-483a-91a5-f77521c0205c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e5f171-7803-426d-b0f5-7623808db7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:14 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Volume volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6 (30146a7c-61dd-4d27-ac70-2adee9ebe3d6): created successfully
Jul 03 23:53:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e5f171-7803-426d-b0f5-7623808db7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Flow 'volume_create_manager' (a37c3a65-0140-4846-9501-e0e1e86f2477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:14 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4fbd6384-f37e-4056-b651-1d277f968b17 tempest-VolumesListAdminTestJSON-2004297882 None] Created volume successfully.
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Flow 'volume_create_manager' (25d9ceb3-5c4a-4dcb-b472-02de0482afd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c16bf7-6011-4804-9a0f-98aff7077b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c16bf7-6011-4804-9a0f-98aff7077b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-666575767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3031e6af65364f79b5c1ce0661260beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:15Z,use_quota=True,user_id='a8db78227557446f9bb417bca5158b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb822aa-5d3e-409f-9c81-f38bee6f7101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb822aa-5d3e-409f-9c81-f38bee6f7101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d06d52-ddd1-4ad4-84eb-fa3d39b91a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d06d52-ddd1-4ad4-84eb-fa3d39b91a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6', 'volume_name': 'volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c858b2-b50e-402b-b34d-5413776d26e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c858b2-b50e-402b-b34d-5413776d26e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7616e062-a1f7-4b01-b415-f0b1a94a8e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:15 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Volume 91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6', 'volume_size': 1}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-666575767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3031e6af65364f79b5c1ce0661260beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:15Z,use_quota=True,user_id='a8db78227557446f9bb417bca5158b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Creating volume 91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:53:15 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:53:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:15 devstack sudo[92659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6 1073741824
Jul 03 23:53:15 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:16 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6 1073741824" returned: 0 in 0.949s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:16 devstack sudo[92664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6
Jul 03 23:53:16 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:16 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6" returned: 0 in 0.750s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:53:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7616e062-a1f7-4b01-b415-f0b1a94a8e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f9db66-bb42-4ab3-be9a-9b81345c1b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:17 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Volume volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6 (91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6): created successfully
Jul 03 23:53:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f9db66-bb42-4ab3-be9a-9b81345c1b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Flow 'volume_create_manager' (25d9ceb3-5c4a-4dcb-b472-02de0482afd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:17 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5015a75c-4716-47ed-9cfd-a0032bf3148c tempest-VolumesListAdminTestJSON-2004297882 None] Created volume successfully.
Jul 03 23:53:17 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:53:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Flow 'volume_create_manager' (6f3fdce4-6cb7-4c20-8baa-1122330ca341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e13230-57f6-4817-b3a8-16d687232ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e13230-57f6-4817-b3a8-16d687232ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-171605930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2e22af-8093-4bb3-9c50-fc8729cac2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3031e6af65364f79b5c1ce0661260beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:18Z,use_quota=True,user_id='a8db78227557446f9bb417bca5158b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecf908e-baa0-43b2-b038-638b1f61adfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecf908e-baa0-43b2-b038-638b1f61adfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e27596e-8a7e-45b9-afdc-29339714bfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e27596e-8a7e-45b9-afdc-29339714bfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c2e22af-8093-4bb3-9c50-fc8729cac2a2', 'volume_name': 'volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74dbcb3-c2a3-4e1a-a428-b29245853514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d74dbcb3-c2a3-4e1a-a428-b29245853514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5b20f8-b202-48b2-98cb-cd53432ce04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:18 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Volume 7c2e22af-8093-4bb3-9c50-fc8729cac2a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2', 'volume_size': 1}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-171605930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2e22af-8093-4bb3-9c50-fc8729cac2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3031e6af65364f79b5c1ce0661260beb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:18Z,use_quota=True,user_id='a8db78227557446f9bb417bca5158b77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Creating volume 7c2e22af-8093-4bb3-9c50-fc8729cac2a2 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:53:18 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:53:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:18 devstack sudo[92667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2 1073741824
Jul 03 23:53:18 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:19 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2 1073741824" returned: 0 in 1.230s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:19 devstack sudo[92695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2
Jul 03 23:53:19 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "cinder-093f6869-3eba-42ac-b11a-ae49e8d16c69-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "cinder-093f6869-3eba-42ac-b11a-ae49e8d16c69-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "cinder-quobyte-093f6869-3eba-42ac-b11a-ae49e8d16c69" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "cinder-quobyte-093f6869-3eba-42ac-b11a-ae49e8d16c69" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:20 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1148d198-7a31-443c-a361-15fe70a083b7]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2" returned: 0 in 0.922s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] <== create_volume: return (2241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c5b20f8-b202-48b2-98cb-cd53432ce04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c977c17b-cf4e-4d44-ba6b-f823ef0c9e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:20 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Volume volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2 (7c2e22af-8093-4bb3-9c50-fc8729cac2a2): created successfully
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c977c17b-cf4e-4d44-ba6b-f823ef0c9e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Flow 'volume_create_manager' (6f3fdce4-6cb7-4c20-8baa-1122330ca341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:20 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-41a09f19-08be-49f2-b13d-8cf1a5f20fb4 tempest-VolumesListAdminTestJSON-2004297882 None] Created volume successfully.
Jul 03 23:53:20 devstack sudo[92700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69
Jul 03 23:53:20 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:21 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69" returned: 0 in 0.815s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:21 devstack sudo[92730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69
Jul 03 23:53:21 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=52,cinder:INSERT=13,cinder:UPDATE=46,cinder:DELETE=5 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=47,cinder:SELECT=52,cinder:DELETE=4,cinder:INSERT=6 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Flow 'volume_create_manager' (1310264c-50aa-421b-b174-24a48da4ac72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6f5858-edc2-4709-b883-13768e6a20b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:21 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6f5858-edc2-4709-b883-13768e6a20b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda5b2c5-a1ee-4c16-8836-b7393acd408e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea50dee2060a4f559788df39bbf159c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:22Z,use_quota=True,user_id='911bb89f6b034c96aab19d14034c3a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f5a2be-8e55-462a-9f52-9b7928dd6d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f5a2be-8e55-462a-9f52-9b7928dd6d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d63692e-2eff-4589-b46d-0913829d7532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d63692e-2eff-4589-b46d-0913829d7532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda5b2c5-a1ee-4c16-8836-b7393acd408e', 'volume_name': 'volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af0e803-5373-434d-beb5-17ccca1a3282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af0e803-5373-434d-beb5-17ccca1a3282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c9a93b-8609-46ff-8b71-b5604e407adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:21 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Volume fda5b2c5-a1ee-4c16-8836-b7393acd408e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e', 'volume_size': 1}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda5b2c5-a1ee-4c16-8836-b7393acd408e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea50dee2060a4f559788df39bbf159c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:22Z,use_quota=True,user_id='911bb89f6b034c96aab19d14034c3a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Creating volume fda5b2c5-a1ee-4c16-8836-b7393acd408e {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:53:21 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:53:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-093f6869-3eba-42ac-b11a-ae49e8d16c69" returned: 0 in 0.856s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:22 devstack sudo[92733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e 1073741824
Jul 03 23:53:22 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "cinder-quobyte-093f6869-3eba-42ac-b11a-ae49e8d16c69" released by "delete_volume" :: held 1.719s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Created reservations ['33e67a21-39b2-424c-afa5-61f8ae471399', '13e3c88d-695f-4b56-ad1f-8a807fcdb045', 'b627e3ce-47f1-4dda-aaeb-621afb8c764c', '744c0f38-d5b5-4277-b8fb-9fd2e464efd8'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:22 devstack sudo[92735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:53:22 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "cinder-735b4175-3d72-4abb-bce4-6e2aebdd0dae-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Lock "cinder-735b4175-3d72-4abb-bce4-6e2aebdd0dae-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "cinder-quobyte-735b4175-3d72-4abb-bce4-6e2aebdd0dae" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Lock "cinder-quobyte-735b4175-3d72-4abb-bce4-6e2aebdd0dae" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ad7c83-86cd-4851-9837-2574d2734893]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:22 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.732s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:22 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Deleted volume successfully.
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ab2bbc49-a988-4203-93ad-225ff90fbb80 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "cinder-093f6869-3eba-42ac-b11a-ae49e8d16c69-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:22 devstack sudo[92745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae
Jul 03 23:53:22 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:22 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e 1073741824" returned: 0 in 0.973s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:23 devstack sudo[92747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e
Jul 03 23:53:23 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:23 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae" returned: 0 in 0.847s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:23 devstack sudo[92761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae
Jul 03 23:53:23 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:23 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e" returned: 0 in 0.698s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:53:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c9a93b-8609-46ff-8b71-b5604e407adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0773a81e-16a4-4c54-8a0a-d13fa4091709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:23 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Volume volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e (fda5b2c5-a1ee-4c16-8836-b7393acd408e): created successfully
Jul 03 23:53:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0773a81e-16a4-4c54-8a0a-d13fa4091709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Flow 'volume_create_manager' (1310264c-50aa-421b-b174-24a48da4ac72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:23 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c2dc8ba4-508c-4a06-bf1b-1c20ccaca460 tempest-VolumesListAdminTestJSON-557683031 None] Created volume successfully.
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Acquiring lock "cinder-fda5b2c5-a1ee-4c16-8836-b7393acd408e-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Lock "cinder-fda5b2c5-a1ee-4c16-8836-b7393acd408e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Acquiring lock "cinder-quobyte-fda5b2c5-a1ee-4c16-8836-b7393acd408e" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Lock "cinder-quobyte-fda5b2c5-a1ee-4c16-8836-b7393acd408e" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6d5845-7740-445f-90d0-a1a489c9d7a0]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "cinder-7c2e22af-8093-4bb3-9c50-fc8729cac2a2-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Lock "cinder-7c2e22af-8093-4bb3-9c50-fc8729cac2a2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "cinder-quobyte-7c2e22af-8093-4bb3-9c50-fc8729cac2a2" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:24 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-735b4175-3d72-4abb-bce4-6e2aebdd0dae" returned: 0 in 0.674s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Lock "cinder-quobyte-7c2e22af-8093-4bb3-9c50-fc8729cac2a2" acquired by "delete_volume" :: waited 0.036s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Lock "cinder-quobyte-735b4175-3d72-4abb-bce4-6e2aebdd0dae" released by "delete_volume" :: held 1.580s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:24 devstack sudo[92764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e
Jul 03 23:53:24 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a80ef14-f5c3-470a-a30d-1c18f114d43d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Created reservations ['2238d1cb-2ef4-4f73-8531-ee4430147f91', '90862a1d-776c-4252-80ba-c2379b4d360e', '3ed18273-8828-483f-b2a2-e700b77cf0bb', 'a7b1483b-e3a4-4ba9-8246-7b130aab69d8'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:53:24 devstack sudo[92766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2
Jul 03 23:53:24 devstack sudo[92766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:24 devstack sudo[92768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:53:24 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "cinder-30074788-8b41-4098-b61b-7c8645b554c3-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "cinder-30074788-8b41-4098-b61b-7c8645b554c3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:25 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "cinder-quobyte-30074788-8b41-4098-b61b-7c8645b554c3" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e" returned: 0 in 1.063s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "cinder-quobyte-30074788-8b41-4098-b61b-7c8645b554c3" acquired by "delete_volume" :: waited 0.047s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:25 devstack sudo[92777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e
Jul 03 23:53:25 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d948b1-8bb6-4058-864d-3e0662aeec05]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:25 devstack sudo[92766]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2" returned: 0 in 1.109s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:25 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.993s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:25 devstack sudo[92780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:25 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:25 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Deleted volume successfully.
Jul 03 23:53:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b910d4e6-56ea-4a25-8a01-02900669065f tempest-AttachVolumeNegativeTest-1274739212 None] Lock "cinder-735b4175-3d72-4abb-bce4-6e2aebdd0dae-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:25 devstack sudo[92779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3
Jul 03 23:53:25 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:26 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fda5b2c5-a1ee-4c16-8836-b7393acd408e" returned: 0 in 0.844s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Lock "cinder-quobyte-fda5b2c5-a1ee-4c16-8836-b7393acd408e" released by "delete_volume" :: held 1.969s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Created reservations ['8d173d81-5429-4643-a695-749b082383ee', '67fa56e8-dc41-4fce-ae88-037166b0b552', 'de5e8432-9609-4f6c-b02e-3ce7f6a843cc', '548d3181-d04f-45a5-bdb8-b59d44317594'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:26 devstack sudo[92789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:53:26 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:26 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7c2e22af-8093-4bb3-9c50-fc8729cac2a2" returned: 0 in 0.851s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Lock "cinder-quobyte-7c2e22af-8093-4bb3-9c50-fc8729cac2a2" released by "delete_volume" :: held 2.021s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:26 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3" returned: 0 in 1.066s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Created reservations ['76cee442-2a3b-45df-81c8-bb6a2e4ef8f2', 'ae632815-b24d-4cb2-8ae6-7c0845d1b4f1', '06fdf59c-8fed-4f5f-9264-e4997648f99e', 'dc371475-51c4-4f16-b43a-008cc39931a4'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:53:26 devstack sudo[92791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3
Jul 03 23:53:26 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:26 devstack sudo[92793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:53:26 devstack sudo[92793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "cinder-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Lock "cinder-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "cinder-quobyte-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Lock "cinder-quobyte-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5cc1de-cb6a-4c45-82a9-44b4af33338e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:27 devstack sudo[92795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6
Jul 03 23:53:27 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:27 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.034s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Deleted volume successfully.
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0e910fe5-0f79-42c9-aab5-73b14074fd4a tempest-VolumesListAdminTestJSON-557683031 None] Lock "cinder-fda5b2c5-a1ee-4c16-8836-b7393acd408e-delete_volume" released by "delete_volume" :: held 3.243s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:27 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30074788-8b41-4098-b61b-7c8645b554c3" returned: 0 in 1.053s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "cinder-quobyte-30074788-8b41-4098-b61b-7c8645b554c3" released by "delete_volume" :: held 2.221s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Created reservations ['1cdcf696-8112-4235-9ec7-bacfd8bb4c1c', '8ded9ea1-d544-4bdd-b374-882d523d574a', 'bad6f0c8-8601-49ac-89d2-7e41f85de35a', 'e674152e-9a2b-4560-9182-52f4026e3c1c'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:53:27 devstack sudo[92793]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.106s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Deleted volume successfully.
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e6bdc571-872a-4230-abdd-c4a7452eedce tempest-VolumesListAdminTestJSON-2004297882 None] Lock "cinder-7c2e22af-8093-4bb3-9c50-fc8729cac2a2-delete_volume" released by "delete_volume" :: held 3.477s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:27 devstack sudo[92801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:53:27 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:28 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6" returned: 0 in 1.245s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:28 devstack sudo[92809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6
Jul 03 23:53:28 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:28 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.860s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:28 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:28 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Deleted volume successfully.
Jul 03 23:53:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e92779af-f846-46a7-99de-9211f49f6279 tempest-AttachVolumeNegativeTest-1274739212 None] Lock "cinder-30074788-8b41-4098-b61b-7c8645b554c3-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:29 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6" returned: 0 in 1.144s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:29 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Lock "cinder-quobyte-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6" released by "delete_volume" :: held 2.447s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:29 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Created reservations ['c81abb4d-c23c-4929-ac7f-d08754db56d8', 'dda3630d-512b-4ccc-9e2a-eddd123db754', '2c62e15b-27b3-4d2d-b891-ea792aacad5b', '81a5842c-78e8-4b80-860c-339b76a4d8b3'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:53:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:29 devstack sudo[92829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:53:29 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "cinder-30146a7c-61dd-4d27-ac70-2adee9ebe3d6-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:30 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.930s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:30 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:30 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Deleted volume successfully.
Jul 03 23:53:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "cinder-30146a7c-61dd-4d27-ac70-2adee9ebe3d6-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6a70b398-bab8-48dd-ab05-24a956a3307b tempest-VolumesListAdminTestJSON-2004297882 None] Lock "cinder-91cb5bdb-aee7-49f0-90a5-e0b9f2109cf6-delete_volume" released by "delete_volume" :: held 3.706s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "cinder-quobyte-30146a7c-61dd-4d27-ac70-2adee9ebe3d6" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "cinder-quobyte-30146a7c-61dd-4d27-ac70-2adee9ebe3d6" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:30 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[28098f6f-21eb-4605-ae51-555ada06474e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:30 devstack sudo[92849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6
Jul 03 23:53:30 devstack sudo[92849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:30 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-aaabbca6-e1f0-439e-be3b-f3fc845ebbc7 req-cd456696-c3e4-4f4d-8f33-2cfc19b11bcc tempest-ServerActionsTestOtherA-1656019275 None] Terminate volume connection completed successfully.
Jul 03 23:53:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-aaabbca6-e1f0-439e-be3b-f3fc845ebbc7 req-cd456696-c3e4-4f4d-8f33-2cfc19b11bcc tempest-ServerActionsTestOtherA-1656019275 None] Deleting attachment 24f714e1-dcd6-4610-92f5-2b31023f97a2. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:53:31 devstack sudo[92849]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6" returned: 0 in 0.860s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:31 devstack sudo[92858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6
Jul 03 23:53:31 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:32 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-30146a7c-61dd-4d27-ac70-2adee9ebe3d6" returned: 0 in 0.699s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "cinder-quobyte-30146a7c-61dd-4d27-ac70-2adee9ebe3d6" released by "delete_volume" :: held 1.637s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:32 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Created reservations ['b52f0e62-cdac-4dea-ab10-3dd9e950fd48', 'c6003810-7dd3-4152-82b0-21f00f0c0bdb', 'adf13765-e8c7-45ca-afe4-86abf7e0cfd4', '8ffa0aab-a826-41cc-b810-b51b3c079303'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:53:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:32 devstack sudo[92861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:53:32 devstack sudo[92861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:33 devstack sudo[92861]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.828s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:33 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:33 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Deleted volume successfully.
Jul 03 23:53:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f4167269-a725-44b2-aeb1-926304ed1385 tempest-VolumesListAdminTestJSON-2004297882 None] Lock "cinder-30146a7c-61dd-4d27-ac70-2adee9ebe3d6-delete_volume" released by "delete_volume" :: held 2.774s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Flow 'volume_create_manager' (c9e4dc40-a968-43bd-ae2d-2a25c1267d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e57b4ad-af3d-42bc-9a84-1a7970ac5148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e57b4ad-af3d-42bc-9a84-1a7970ac5148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-318332440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='240a3eab1b0848aeadb8c61854b2b4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:42Z,use_quota=True,user_id='0f2f8056eb7a44a798edae70870a5517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82cd9e0a-49b7-452e-ac12-267dccd2cb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82cd9e0a-49b7-452e-ac12-267dccd2cb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8432dd73-5ae2-4e4f-81e5-065b2a4aadfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8432dd73-5ae2-4e4f-81e5-065b2a4aadfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b', 'volume_name': 'volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ef7d46-fc71-4377-9218-cb79271f3861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66ef7d46-fc71-4377-9218-cb79271f3861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a988f94-087b-4990-95f1-9d844fd7c6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:41 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Volume 85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b', 'volume_size': 1}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-318332440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='240a3eab1b0848aeadb8c61854b2b4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:42Z,use_quota=True,user_id='0f2f8056eb7a44a798edae70870a5517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Creating volume 85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:53:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:53:42 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:53:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:42 devstack sudo[92960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b 1073741824
Jul 03 23:53:42 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:43 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b 1073741824" returned: 0 in 1.082s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:43 devstack sudo[92967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b
Jul 03 23:53:43 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:44 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b" returned: 0 in 0.965s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a988f94-087b-4990-95f1-9d844fd7c6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f711240-7ab7-4d2c-a8c9-e981b39ea8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:44 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Volume volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b (85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b): created successfully
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f711240-7ab7-4d2c-a8c9-e981b39ea8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Flow 'volume_create_manager' (c9e4dc40-a968-43bd-ae2d-2a25c1267d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-09a56dbf-29cd-4cc0-b0ad-173931cb4a2b tempest-VolumesTransfersV355Test-476257031 None] Created volume successfully.
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Acquiring lock "cinder-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Lock "cinder-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Acquiring lock "cinder-quobyte-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Lock "cinder-quobyte-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d" acquired by "delete_volume" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2729fc50-5c64-4d32-9dda-53badea205f1]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:44 devstack sudo[92970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d
Jul 03 23:53:44 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:45 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d" returned: 0 in 0.884s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:45 devstack sudo[92975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d
Jul 03 23:53:45 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:45 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f5ae8766-e5a3-49c1-979d-f479b20c5ff0 tempest-GroupSnapshotsTest-1139627404 None] Group tempest-GroupSnapshotsTest-Group-569370926: creating
Jul 03 23:53:45 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f5ae8766-e5a3-49c1-979d-f479b20c5ff0 tempest-GroupSnapshotsTest-1139627404 None] Group tempest-GroupSnapshotsTest-Group-569370926: created successfully
Jul 03 23:53:45 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f5ae8766-e5a3-49c1-979d-f479b20c5ff0 tempest-GroupSnapshotsTest-1139627404 None] Create group completed successfully.
Jul 03 23:53:45 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8a259f67-171e-4b74-90f4-3ce7e5e8d6aa tempest-VolumesTransfersV355Test-679090274 None] Transfer volume completed successfully.
Jul 03 23:53:46 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d" returned: 0 in 0.757s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Lock "cinder-quobyte-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d" released by "delete_volume" :: held 1.691s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:46 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Created reservations ['81f4d73a-c146-494e-958f-b1bdc067a5d9', '8a0211cc-9f9e-4148-877f-4263989dee45', '52aabe25-12f6-4bc9-abd9-05d3775a2b06', '670de454-56d8-45bf-8235-65f39f11c0ee'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:53:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:46 devstack sudo[92978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:53:46 devstack sudo[92978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:47 devstack sudo[92978]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Acquiring lock "cinder-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.842s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:47 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Deleted volume successfully.
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Lock "cinder-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7b3f02f5-b332-4ea5-8e71-d8a25ae8f436 tempest-ServerActionsTestOtherA-1656019275 None] Lock "cinder-0f2455ad-30c9-4bd0-a5ef-39e58cb90a8d-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Acquiring lock "cinder-quobyte-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Lock "cinder-quobyte-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d79cf2-e4df-4c44-a14c-c62b14d9b6a9]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:47 devstack sudo[92983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b
Jul 03 23:53:47 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Flow 'volume_create_manager' (575debb4-7229-43b8-9b36-9c8806626024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae7bac1-0d2a-4081-890b-de3cfda10f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae7bac1-0d2a-4081-890b-de3cfda10f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1683306610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e840a6c2-d239-4f00-90cf-bde7cadd323b,host='devstack@QuobyteHD#QuobyteHD',id=4a740dd8-2821-4184-826c-589f1e24c3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c311e6287429c8c626eb987710e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:48Z,use_quota=True,user_id='7cf328da5b3d4fc9bdae9cee4075d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9beee512-3b83-4ff3-8ca0-ace1ed11bedd),volume_type_id=9beee512-3b83-4ff3-8ca0-ace1ed11bedd)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3efe1c36-9b4a-4db8-85b4-a2dd40febbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3efe1c36-9b4a-4db8-85b4-a2dd40febbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbbcc1c-cd3d-48a3-b15c-23859fcc0878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fbbcc1c-cd3d-48a3-b15c-23859fcc0878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a740dd8-2821-4184-826c-589f1e24c3ff', 'volume_name': 'volume-4a740dd8-2821-4184-826c-589f1e24c3ff', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d37e0a-4c88-4934-8bde-f997c73abe1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d37e0a-4c88-4934-8bde-f997c73abe1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be32811d-e90b-440e-9578-7ac99893c8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:47 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Volume 4a740dd8-2821-4184-826c-589f1e24c3ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a740dd8-2821-4184-826c-589f1e24c3ff', 'volume_size': 1}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e840a6c2-d239-4f00-90cf-bde7cadd323b,created_at=2026-07-03T21:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1683306610',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e840a6c2-d239-4f00-90cf-bde7cadd323b,host='devstack@QuobyteHD#QuobyteHD',id=4a740dd8-2821-4184-826c-589f1e24c3ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c311e6287429c8c626eb987710e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:48Z,use_quota=True,user_id='7cf328da5b3d4fc9bdae9cee4075d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9beee512-3b83-4ff3-8ca0-ace1ed11bedd),volume_type_id=9beee512-3b83-4ff3-8ca0-ace1ed11bedd)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Creating volume 4a740dd8-2821-4184-826c-589f1e24c3ff {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:53:47 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:53:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:47 devstack sudo[92985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff 1073741824
Jul 03 23:53:47 devstack sudo[92985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:48 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b" returned: 0 in 0.994s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:48 devstack sudo[92995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b
Jul 03 23:53:48 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:48 devstack sudo[92985]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff 1073741824" returned: 0 in 0.921s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:48 devstack sudo[93002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff
Jul 03 23:53:48 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:49 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b" returned: 0 in 1.301s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Lock "cinder-quobyte-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b" released by "delete_volume" :: held 2.348s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:49 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Created reservations ['fcd8fcd1-c112-4bcb-a823-eada4a61eb61', 'fcfc3e30-5bc9-4039-8ca1-431ec88955d8', '78acad8e-f335-417e-947b-c83f148bbe19', '81d8a833-8104-4e6a-9390-ff319f9c29f0'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:53:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:49 devstack sudo[93040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:53:49 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:50 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff" returned: 0 in 1.285s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] <== create_volume: return (2261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.264s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be32811d-e90b-440e-9578-7ac99893c8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a740dd8-2821-4184-826c-589f1e24c3ff', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6543a80-9765-47b7-af22-2793facfa45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:50 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Volume volume-4a740dd8-2821-4184-826c-589f1e24c3ff (4a740dd8-2821-4184-826c-589f1e24c3ff): created successfully
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6543a80-9765-47b7-af22-2793facfa45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Flow 'volume_create_manager' (575debb4-7229-43b8-9b36-9c8806626024) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:50 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-681ee086-dd40-4b9e-bac8-79c5a9d62dd6 tempest-GroupSnapshotsTest-1139627404 None] Created volume successfully.
Jul 03 23:53:50 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.786s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:50 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Deleted volume successfully.
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a459d61b-a1c8-4d30-8379-04f3da3c35bd tempest-VolumesTransfersV355Test-682509458 None] Lock "cinder-85ab03ce-164e-4f06-ab7b-8fbba0f6ff5b-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:50 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] GroupSnapshot f95b0731-68a9-46af-adba-6df4efd21590: creating.
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] Group snapshot f95b0731-68a9-46af-adba-6df4efd21590: creating. {{(pid=86648) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] Creating offline snapshot 61484a81-8f44-4a80-8b9f-f95c63f6e9bc of volume 4a740dd8-2821-4184-826c-589f1e24c3ff {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef276097-b850-4e35-a4bf-10adcfa92081]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:51 devstack sudo[93047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff
Jul 03 23:53:51 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Flow 'volume_create_manager' (bdc9b35e-b6b0-49d5-82bb-f257d97fcb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84fde97-6a90-481b-ac18-c64f3cd46a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f84fde97-6a90-481b-ac18-c64f3cd46a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-868061028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244e5c83-38f0-41b9-af2c-010105da56c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='240a3eab1b0848aeadb8c61854b2b4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:51Z,use_quota=True,user_id='0f2f8056eb7a44a798edae70870a5517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fed85d-3b37-45ce-8cb5-63a90d96681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5fed85d-3b37-45ce-8cb5-63a90d96681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402d6813-eaf0-4225-961c-c696454e8591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402d6813-eaf0-4225-961c-c696454e8591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244e5c83-38f0-41b9-af2c-010105da56c7', 'volume_name': 'volume-244e5c83-38f0-41b9-af2c-010105da56c7', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978a4223-21e5-4e7b-a9b9-632c9f023153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978a4223-21e5-4e7b-a9b9-632c9f023153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffa427f-f568-4a96-845d-a0887f0317f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:51 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Volume 244e5c83-38f0-41b9-af2c-010105da56c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244e5c83-38f0-41b9-af2c-010105da56c7', 'volume_size': 1}
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:51 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff" returned: 0 in 0.917s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:51 devstack sudo[93053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc 1G
Jul 03 23:53:51 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:52 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc 1G" returned: 0 in 0.879s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a740dd8-2821-4184-826c-589f1e24c3ff -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:52 devstack sudo[93059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a740dd8-2821-4184-826c-589f1e24c3ff -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc
Jul 03 23:53:52 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:53 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a740dd8-2821-4184-826c-589f1e24c3ff -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc" returned: 0 in 0.690s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:53 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:53:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:53 devstack sudo[93064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc
Jul 03 23:53:53 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:54 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc" returned: 0 in 0.652s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:54 devstack sudo[93067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.info
Jul 03 23:53:54 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:54 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.info" returned: 0 in 0.638s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:54 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:53:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:54 devstack sudo[93070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.info
Jul 03 23:53:54 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:55 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.info" returned: 0 in 0.684s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.562s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.119s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-868061028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244e5c83-38f0-41b9-af2c-010105da56c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='240a3eab1b0848aeadb8c61854b2b4be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:51Z,use_quota=True,user_id='0f2f8056eb7a44a798edae70870a5517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:53:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Creating volume 244e5c83-38f0-41b9-af2c-010105da56c7 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:53:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:53:55 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:53:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-244e5c83-38f0-41b9-af2c-010105da56c7 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:55 devstack sudo[93073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-244e5c83-38f0-41b9-af2c-010105da56c7 1073741824
Jul 03 23:53:55 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:55 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6a103444-936e-4ac4-bf79-c99493993723 tempest-GroupSnapshotsTest-1139627404 None] group_snapshot f95b0731-68a9-46af-adba-6df4efd21590: created successfully
Jul 03 23:53:56 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-244e5c83-38f0-41b9-af2c-010105da56c7 1073741824" returned: 0 in 1.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-244e5c83-38f0-41b9-af2c-010105da56c7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:56 devstack sudo[93079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-244e5c83-38f0-41b9-af2c-010105da56c7
Jul 03 23:53:56 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:57 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-244e5c83-38f0-41b9-af2c-010105da56c7" returned: 0 in 0.760s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffa427f-f568-4a96-845d-a0887f0317f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244e5c83-38f0-41b9-af2c-010105da56c7', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64a7ef0-afee-4f37-b6bf-25b19043710e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:57 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Volume volume-244e5c83-38f0-41b9-af2c-010105da56c7 (244e5c83-38f0-41b9-af2c-010105da56c7): created successfully
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d64a7ef0-afee-4f37-b6bf-25b19043710e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Flow 'volume_create_manager' (bdc9b35e-b6b0-49d5-82bb-f257d97fcb73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:57 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ee99e6e4-5d54-438c-99b1-af8f5deb53b0 tempest-VolumesTransfersV355Test-476257031 None] Created volume successfully.
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-61484a81-8f44-4a80-8b9f-f95c63f6e9bc-013895a7-42eb-4e36-9387-2a337cbe06e7" by "_create_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-61484a81-8f44-4a80-8b9f-f95c63f6e9bc-013895a7-42eb-4e36-9387-2a337cbe06e7" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Creating volume 013895a7-42eb-4e36-9387-2a337cbe06e7 from snapshot 61484a81-8f44-4a80-8b9f-f95c63f6e9bc {{(pid=86648) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-013895a7-42eb-4e36-9387-2a337cbe06e7" by "_copy_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-013895a7-42eb-4e36-9387-2a337cbe06e7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] snapshot: 61484a81-8f44-4a80-8b9f-f95c63f6e9bc, volume: 013895a7-42eb-4e36-9387-2a337cbe06e7,  {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[45531cfe-391d-4f15-b83b-76a8f5ef3e09]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:57 devstack sudo[93082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc
Jul 03 23:53:57 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Acquiring lock "cinder-244e5c83-38f0-41b9-af2c-010105da56c7-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Lock "cinder-244e5c83-38f0-41b9-af2c-010105da56c7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Acquiring lock "cinder-quobyte-244e5c83-38f0-41b9-af2c-010105da56c7" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Lock "cinder-quobyte-244e5c83-38f0-41b9-af2c-010105da56c7" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e4eeba-8b0c-4eb3-8a32-eb79b4d085af]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-244e5c83-38f0-41b9-af2c-010105da56c7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:58 devstack sudo[93085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-244e5c83-38f0-41b9-af2c-010105da56c7
Jul 03 23:53:58 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:58 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc" returned: 0 in 0.956s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a740dd8-2821-4184-826c-589f1e24c3ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:53:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] will copy from snapshot at /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 23:53:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Creating direct copy from snapshot {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 23:53:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa48943-4860-454c-ab48-8758cf80d749]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:58 devstack sudo[93091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff
Jul 03 23:53:58 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:59 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-244e5c83-38f0-41b9-af2c-010105da56c7" returned: 0 in 0.895s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-244e5c83-38f0-41b9-af2c-010105da56c7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:59 devstack sudo[93097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-244e5c83-38f0-41b9-af2c-010105da56c7
Jul 03 23:53:59 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:59 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff" returned: 0 in 0.914s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:59 devstack cinder-volume[86648]: DEBUG cinder.utils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Path /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7 not found in is_blk_device check {{(pid=86648) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 23:53:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:59 devstack sudo[93102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7
Jul 03 23:53:59 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:00 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-244e5c83-38f0-41b9-af2c-010105da56c7" returned: 0 in 0.995s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Lock "cinder-quobyte-244e5c83-38f0-41b9-af2c-010105da56c7" released by "delete_volume" :: held 1.933s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:00 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Created reservations ['64690fd2-22eb-42a9-a4f5-c72daf455fdb', '478466aa-10e8-4d6c-a914-4c5cfbb8c734', '2c44f038-c99b-468d-9536-6b516309d2aa', '8d3ff1de-eb95-49ac-8b6d-6b005bda96cf'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:00 devstack sudo[93112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:54:00 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:02 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.824s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:02 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:54:02 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Deleted volume successfully.
Jul 03 23:54:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0baac5c0-d26f-4bcf-870e-6a3e6a2a4e3a tempest-VolumesTransfersV355Test-682509458 None] Lock "cinder-244e5c83-38f0-41b9-af2c-010105da56c7-delete_volume" released by "delete_volume" :: held 4.091s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:03 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Flow 'volume_create_manager' (12b69b85-8a8d-4921-81b2-260308b199d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29aabb25-275f-4d5b-b422-bd0fce50a876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29aabb25-275f-4d5b-b422-bd0fce50a876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1604614628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b00a4f-5a72-4dc3-a8ac-165d9c012bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105f5d27fc054f929e79df608d428648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:03Z,use_quota=True,user_id='a9cd52b3602b49ec934157cd4a1f8a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55289b7c-f26f-4361-b4ae-0d3ab24bd050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55289b7c-f26f-4361-b4ae-0d3ab24bd050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2d1fed-083a-426b-9bbd-758a2f4b46ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2d1fed-083a-426b-9bbd-758a2f4b46ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62b00a4f-5a72-4dc3-a8ac-165d9c012bf9', 'volume_name': 'volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65c1ac3-949b-4f94-96cf-e493d752e259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65c1ac3-949b-4f94-96cf-e493d752e259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de13fd7a-d216-4e4d-9cb3-291dd8bdac80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:03 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Volume 62b00a4f-5a72-4dc3-a8ac-165d9c012bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9', 'volume_size': 1}
Jul 03 23:54:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:54:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:05 devstack sudo[93173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:54:05 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.116s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:06 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:06 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:54:06 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:54:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 8 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:54:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:54:06 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7" returned: 0 in 7.384s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[62030c50-03b9-43cf-87af-c4f8fbbc30b1]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:07 devstack sudo[93180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff
Jul 03 23:54:07 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:08 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff" returned: 0 in 1.167s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:08 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff, size 1024.00 MB, duration 7.38 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:54:08 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Converted 1024.00 MB image at 138.67 MB/s
Jul 03 23:54:08 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:54:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:08 devstack sudo[93185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7
Jul 03 23:54:08 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:08 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7" returned: 0 in 0.821s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-013895a7-42eb-4e36-9387-2a337cbe06e7" released by "_copy_volume_from_snapshot" :: held 11.424s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-61484a81-8f44-4a80-8b9f-f95c63f6e9bc-013895a7-42eb-4e36-9387-2a337cbe06e7" released by "_create_volume_from_snapshot" :: held 11.474s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.507s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.329s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1604614628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62b00a4f-5a72-4dc3-a8ac-165d9c012bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105f5d27fc054f929e79df608d428648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:03Z,use_quota=True,user_id='a9cd52b3602b49ec934157cd4a1f8a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Creating volume 62b00a4f-5a72-4dc3-a8ac-165d9c012bf9 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:09 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:54:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:09 devstack sudo[93188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9 1073741824
Jul 03 23:54:09 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9f0b0be2-8fec-42c1-9db3-f132c4eb58ce tempest-GroupSnapshotsTest-1139627404 None] Create group from source-snapshot-f95b0731-68a9-46af-adba-6df4efd21590 completed successfully.
Jul 03 23:54:10 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9 1073741824" returned: 0 in 1.114s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:10 devstack sudo[93195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9
Jul 03 23:54:10 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-013895a7-42eb-4e36-9387-2a337cbe06e7" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-013895a7-42eb-4e36-9387-2a337cbe06e7" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:10 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[59677abd-eab0-4bc5-9ba4-b8f49c6edb52]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:10 devstack sudo[93197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7
Jul 03 23:54:10 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:11 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9" returned: 0 in 0.961s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] <== create_volume: return (2159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de13fd7a-d216-4e4d-9cb3-291dd8bdac80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b2a066-f93f-4cd4-b2d3-38db4e8f691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:11 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Volume volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9 (62b00a4f-5a72-4dc3-a8ac-165d9c012bf9): created successfully
Jul 03 23:54:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b2a066-f93f-4cd4-b2d3-38db4e8f691b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Flow 'volume_create_manager' (12b69b85-8a8d-4921-81b2-260308b199d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:11 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d9e4b8df-fef4-4d6b-99ff-8fd8be4a7736 tempest-AttachVolumeTestJSON-1926062192 None] Created volume successfully.
Jul 03 23:54:11 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7" returned: 0 in 1.076s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:11 devstack sudo[93207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7
Jul 03 23:54:11 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:12 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-013895a7-42eb-4e36-9387-2a337cbe06e7" returned: 0 in 0.768s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-013895a7-42eb-4e36-9387-2a337cbe06e7" released by "delete_volume" :: held 1.934s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:12 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['265a0351-7aa2-460e-80fa-bb3d68e7f6f6'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:12 devstack cinder-volume[86648]: WARNING cinder.quota [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1371325322 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1371325322, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:54:12 devstack cinder-volume[86648]: WARNING cinder.quota [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1371325322 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1371325322, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:54:12 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['fc74c995-eba1-4b04-b048-af765f990198', 'b3b1a2b4-4cb3-427f-803b-844841f1c711', '9c60e184-051b-4283-b0d7-9ee6a845c952', '763f0927-9605-46ae-ba36-3ecd20860ef7'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:13 devstack sudo[93210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:54:13 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] group_snapshot f95b0731-68a9-46af-adba-6df4efd21590: deleting
Jul 03 23:54:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] group_snapshot f95b0731-68a9-46af-adba-6df4efd21590: deleting {{(pid=86648) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 23:54:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-4a740dd8-2821-4184-826c-589f1e24c3ff" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-4a740dd8-2821-4184-826c-589f1e24c3ff" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-61484a81-8f44-4a80-8b9f-f95c63f6e9bc" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-61484a81-8f44-4a80-8b9f-f95c63f6e9bc" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Deleting offline snapshot 61484a81-8f44-4a80-8b9f-f95c63f6e9bc of volume 4a740dd8-2821-4184-826c-589f1e24c3ff {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:54:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] snapshot_file for this snap is: volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:54:13 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f9f253-9348-471e-b011-2be52554cdc1]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:13 devstack sudo[93212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc
Jul 03 23:54:13 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:14 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.135s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:14 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:54:14 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-357b7eed-012d-4ccd-b6ee-0f0ebe8b979a tempest-GroupSnapshotsTest-1139627404 None] Delete group completed successfully.
Jul 03 23:54:14 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc" returned: 0 in 1.303s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a740dd8-2821-4184-826c-589f1e24c3ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:54:14 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9928c1-ea86-4ae8-9ec3-cc80bd7b9a73]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-62dca3dd-5bee-4cdb-9392-3629f4a1b1c8 req-523c1797-13dd-4494-8b7f-b9695e8f7420 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-62dca3dd-5bee-4cdb-9392-3629f4a1b1c8 req-523c1797-13dd-4494-8b7f-b9695e8f7420 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:14 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[04766544-4961-444e-8f54-aa4ef142e51e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-62dca3dd-5bee-4cdb-9392-3629f4a1b1c8 req-523c1797-13dd-4494-8b7f-b9695e8f7420 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:15 devstack sudo[93227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff
Jul 03 23:54:15 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:15 devstack sudo[93228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9
Jul 03 23:54:15 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:15 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff" returned: 0 in 0.898s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:15 devstack sudo[93235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc
Jul 03 23:54:15 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:16 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-62dca3dd-5bee-4cdb-9392-3629f4a1b1c8 req-523c1797-13dd-4494-8b7f-b9695e8f7420 tempest-AttachVolumeTestJSON-1926062192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9" returned: 0 in 1.159s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-62dca3dd-5bee-4cdb-9392-3629f4a1b1c8 req-523c1797-13dd-4494-8b7f-b9695e8f7420 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.199s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Flow 'volume_create_manager' (9ba651d7-7525-437f-80d7-0a80d6c50787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e132bc-b6e1-48f5-844e-62e5f6067b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-62dca3dd-5bee-4cdb-9392-3629f4a1b1c8 req-523c1797-13dd-4494-8b7f-b9695e8f7420 tempest-AttachVolumeTestJSON-1926062192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fdc33393-cf46-4f6d-90a0-dd0947e7ee3d', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e132bc-b6e1-48f5-844e-62e5f6067b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-697230141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1010ffb6-d8b4-46de-83d3-e5c1a269b550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3595d3d520fe413e9f24d033158d1774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:16Z,use_quota=True,user_id='353acca2ce5b418cb2ee6366557d2310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ab408c-203d-4aae-8077-576f795379e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ab408c-203d-4aae-8077-576f795379e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21cdb02-1dd2-49d6-8cfb-1ef849ac9f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21cdb02-1dd2-49d6-8cfb-1ef849ac9f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1010ffb6-d8b4-46de-83d3-e5c1a269b550', 'volume_name': 'volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495f805f-c07a-4561-a1c6-1fcf736939b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495f805f-c07a-4561-a1c6-1fcf736939b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b3ea1b-b2e9-49cc-9b91-326640d0ae03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:16 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Volume 1010ffb6-d8b4-46de-83d3-e5c1a269b550: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550', 'volume_size': 1}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-697230141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1010ffb6-d8b4-46de-83d3-e5c1a269b550,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3595d3d520fe413e9f24d033158d1774',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:16Z,use_quota=True,user_id='353acca2ce5b418cb2ee6366557d2310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Creating volume 1010ffb6-d8b4-46de-83d3-e5c1a269b550 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:16 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:16 devstack sudo[93240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550 1073741824
Jul 03 23:54:16 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:16 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-62dca3dd-5bee-4cdb-9392-3629f4a1b1c8 req-523c1797-13dd-4494-8b7f-b9695e8f7420 tempest-AttachVolumeTestJSON-1926062192 None] attachment_update completed successfully.
Jul 03 23:54:16 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc" returned: 0 in 1.137s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:16 devstack sudo[93247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc
Jul 03 23:54:16 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:17 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550 1073741824" returned: 0 in 1.396s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:17 devstack sudo[93320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550
Jul 03 23:54:17 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:17 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff.61484a81-8f44-4a80-8b9f-f95c63f6e9bc" returned: 0 in 1.038s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:18 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-61484a81-8f44-4a80-8b9f-f95c63f6e9bc" released by "_delete_snapshot" :: held 4.587s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:18 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-4a740dd8-2821-4184-826c-589f1e24c3ff" released by "delete_snapshot" :: held 4.639s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:18 devstack cinder-volume[86648]: WARNING cinder.quota [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1371325322 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1371325322, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:54:18 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['98c0e1a7-c22f-417f-a9e3-b622c4df1e3d', '36336df7-f01b-421b-a0c7-a3a740441472', 'e46eaab5-619c-438e-bb70-11e437f14e43', 'a72bd95f-631b-4066-be72-ac7495ee4d71'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:18 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-436687ec-d2cd-4805-b614-5659f2628def tempest-GroupSnapshotsTest-1139627404 None] group_snapshot f95b0731-68a9-46af-adba-6df4efd21590: deleted successfully
Jul 03 23:54:18 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550" returned: 0 in 0.786s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] <== create_volume: return (2240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b3ea1b-b2e9-49cc-9b91-326640d0ae03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c714205-900f-4ff7-aa96-a3e7fdcc3262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:18 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Volume volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550 (1010ffb6-d8b4-46de-83d3-e5c1a269b550): created successfully
Jul 03 23:54:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c714205-900f-4ff7-aa96-a3e7fdcc3262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Flow 'volume_create_manager' (9ba651d7-7525-437f-80d7-0a80d6c50787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:18 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-718a8dc7-a0fb-4a20-91ea-c607d5ef513d tempest-VolumesSnapshotListTestJSON-1837009543 None] Created volume successfully.
Jul 03 23:54:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-4a740dd8-2821-4184-826c-589f1e24c3ff" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-4a740dd8-2821-4184-826c-589f1e24c3ff" acquired by "delete_volume" :: waited 0.033s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:19 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[63115a95-8437-46d2-af58-92042e9820bd]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] Creating offline snapshot fb54961a-4ce6-4fa0-8aa3-289084473d78 of volume 1010ffb6-d8b4-46de-83d3-e5c1a269b550 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:54:19 devstack sudo[93638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff
Jul 03 23:54:19 devstack sudo[93638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:20 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91a863f-87fa-48af-a7c6-f060bbdaa7e5]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:20 devstack sudo[93640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550
Jul 03 23:54:20 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:20 devstack sudo[93638]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff" returned: 0 in 0.962s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:20 devstack sudo[93646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff
Jul 03 23:54:20 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:21 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550" returned: 0 in 1.077s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:21 devstack sudo[93651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 1G
Jul 03 23:54:21 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:21 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4a740dd8-2821-4184-826c-589f1e24c3ff" returned: 0 in 0.833s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-4a740dd8-2821-4184-826c-589f1e24c3ff" released by "delete_volume" :: held 1.973s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['63769fdf-6b88-479f-86db-95febe5fea5f'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:21 devstack cinder-volume[86648]: WARNING cinder.db.api [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1371325322']
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['4ac7fcaa-66e8-4334-a0be-9b78b55ac1a8', '21f4d7a4-fe95-4da3-8e21-8ee5352eabe8', 'c01dee53-b046-4e6a-82c3-fe1b56e7f417', '156abb06-3eb4-4b0f-8e0e-39cc1deb80b3'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Flow 'volume_create_manager' (35a5f45a-64af-4b3a-8375-802e399af930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01743a37-3a4b-4ea4-8aa6-bb4c68fb6459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01743a37-3a4b-4ea4-8aa6-bb4c68fb6459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1679015905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e713a76-d779-4cfd-8b56-3042c7f46c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105f5d27fc054f929e79df608d428648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:22Z,use_quota=True,user_id='a9cd52b3602b49ec934157cd4a1f8a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89038bd-f57f-4a88-80fc-d24e2343c4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89038bd-f57f-4a88-80fc-d24e2343c4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1975a9d-96a9-4796-a688-4cccdc605e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1975a9d-96a9-4796-a688-4cccdc605e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e713a76-d779-4cfd-8b56-3042c7f46c01', 'volume_name': 'volume-3e713a76-d779-4cfd-8b56-3042c7f46c01', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1d2fb0-61dd-40c8-8c75-67081dc1091b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d1d2fb0-61dd-40c8-8c75-67081dc1091b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079cd381-50d6-4f27-a227-d9bcbeae2648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:22 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Volume 3e713a76-d779-4cfd-8b56-3042c7f46c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e713a76-d779-4cfd-8b56-3042c7f46c01', 'volume_size': 1}
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:22 devstack sudo[93658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:54:22 devstack sudo[93658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:22 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 1G" returned: 0 in 1.115s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:22 devstack sudo[93660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78
Jul 03 23:54:22 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=105,cinder:INSERT=32,cinder:UPDATE=135,cinder:DELETE=8 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:54:22 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c31838c0-7e3b-4d9b-9bed-5ddada6fde40 tempest-GroupSnapshotsTest-1139627404 None] Group tempest-GroupSnapshotsTest-Group-234767046: creating
Jul 03 23:54:22 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=108,cinder:INSERT=29,cinder:UPDATE=128,cinder:DELETE=8 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:54:22 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c31838c0-7e3b-4d9b-9bed-5ddada6fde40 tempest-GroupSnapshotsTest-1139627404 None] Group tempest-GroupSnapshotsTest-Group-234767046: created successfully
Jul 03 23:54:22 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c31838c0-7e3b-4d9b-9bed-5ddada6fde40 tempest-GroupSnapshotsTest-1139627404 None] Create group completed successfully.
Jul 03 23:54:23 devstack sudo[93658]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.040s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:23 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:54:23 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4223d73b-5d50-49f6-b25c-daa645344931 tempest-GroupSnapshotsTest-1139627404 None] Delete group completed successfully.
Jul 03 23:54:23 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78" returned: 0 in 0.934s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:23 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 is being set with open permissions: ugo+rw
Jul 03 23:54:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:23 devstack sudo[93669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78
Jul 03 23:54:23 devstack sudo[93669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:23 devstack sudo[93669]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78" returned: 0 in 0.844s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:24 devstack sudo[93682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.info
Jul 03 23:54:24 devstack sudo[93682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Flow 'volume_create_manager' (2b238848-6890-40a1-a7c4-876e36b1386f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bdf715-42b8-436d-9893-f574cae1f320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3bdf715-42b8-436d-9893-f574cae1f320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1315369155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef2dfac3-43f9-430d-a74f-75fd109de61b,host='devstack@QuobyteHD#QuobyteHD',id=63e5872a-77e5-4626-b491-e248fed7b41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c311e6287429c8c626eb987710e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:25Z,use_quota=True,user_id='7cf328da5b3d4fc9bdae9cee4075d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41d69f4d-02e9-4d22-aeca-b3f96b0ca91c),volume_type_id=41d69f4d-02e9-4d22-aeca-b3f96b0ca91c)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319173eb-90a7-4f74-9d9c-9093227ef427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319173eb-90a7-4f74-9d9c-9093227ef427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd6db04-cf58-4060-aeea-0d5534a4a863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd6db04-cf58-4060-aeea-0d5534a4a863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63e5872a-77e5-4626-b491-e248fed7b41d', 'volume_name': 'volume-63e5872a-77e5-4626-b491-e248fed7b41d', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0cdef7-5593-4bd1-9dca-4aff11e6e4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0cdef7-5593-4bd1-9dca-4aff11e6e4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f28c63-d095-43da-9ee9-e9209cacc80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:24 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Volume 63e5872a-77e5-4626-b491-e248fed7b41d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63e5872a-77e5-4626-b491-e248fed7b41d', 'volume_size': 1}
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:24 devstack sudo[93682]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.info" returned: 0 in 0.761s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:24 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.info is being set with open permissions: ugo+rw
Jul 03 23:54:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:24 devstack sudo[93686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.info
Jul 03 23:54:24 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:25 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.info" returned: 0 in 0.634s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.496s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.417s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1679015905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e713a76-d779-4cfd-8b56-3042c7f46c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='105f5d27fc054f929e79df608d428648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:22Z,use_quota=True,user_id='a9cd52b3602b49ec934157cd4a1f8a40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Creating volume 3e713a76-d779-4cfd-8b56-3042c7f46c01 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:25 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:54:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:25 devstack sudo[93689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01 1073741824
Jul 03 23:54:25 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:25 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-32d3fe46-b334-42ed-957f-2b1ce57eb813 tempest-VolumesSnapshotListTestJSON-1837009543 None] Create snapshot completed successfully
Jul 03 23:54:26 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01 1073741824" returned: 0 in 0.830s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:26 devstack sudo[93695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01
Jul 03 23:54:26 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:27 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01" returned: 0 in 0.747s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.353s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ef2dfac3-43f9-430d-a74f-75fd109de61b,created_at=2026-07-03T21:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1315369155',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef2dfac3-43f9-430d-a74f-75fd109de61b,host='devstack@QuobyteHD#QuobyteHD',id=63e5872a-77e5-4626-b491-e248fed7b41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c311e6287429c8c626eb987710e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:25Z,use_quota=True,user_id='7cf328da5b3d4fc9bdae9cee4075d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41d69f4d-02e9-4d22-aeca-b3f96b0ca91c),volume_type_id=41d69f4d-02e9-4d22-aeca-b3f96b0ca91c)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Creating volume 63e5872a-77e5-4626-b491-e248fed7b41d {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:27 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:27 devstack sudo[93698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d 1073741824
Jul 03 23:54:27 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (079cd381-50d6-4f27-a227-d9bcbeae2648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e713a76-d779-4cfd-8b56-3042c7f46c01', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ada6fc1-329f-453f-a053-e189d5b1b4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:27 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Volume volume-3e713a76-d779-4cfd-8b56-3042c7f46c01 (3e713a76-d779-4cfd-8b56-3042c7f46c01): created successfully
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ada6fc1-329f-453f-a053-e189d5b1b4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Flow 'volume_create_manager' (35a5f45a-64af-4b3a-8375-802e399af930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d4b8f847-c159-40b0-b0ec-d429b40bf439 tempest-AttachVolumeTestJSON-1926062192 None] Created volume successfully.
Jul 03 23:54:27 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d 1073741824" returned: 0 in 0.883s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:28 devstack sudo[93704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d
Jul 03 23:54:28 devstack sudo[93704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:28 devstack sudo[93704]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d" returned: 0 in 0.770s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.365s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] Creating offline snapshot 8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 of volume 1010ffb6-d8b4-46de-83d3-e5c1a269b550 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:54:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88f28c63-d095-43da-9ee9-e9209cacc80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e5872a-77e5-4626-b491-e248fed7b41d', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd30a217-a2eb-4ea4-b8ee-5bd8195068be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:28 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[11999a84-a21f-4758-8b81-89926569a7ab]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:28 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Volume volume-63e5872a-77e5-4626-b491-e248fed7b41d (63e5872a-77e5-4626-b491-e248fed7b41d): created successfully
Jul 03 23:54:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd30a217-a2eb-4ea4-b8ee-5bd8195068be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Flow 'volume_create_manager' (2b238848-6890-40a1-a7c4-876e36b1386f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:28 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-95052d06-d5bf-41c0-96bd-7ce4fb99d0a5 tempest-GroupSnapshotsTest-1139627404 None] Created volume successfully.
Jul 03 23:54:28 devstack sudo[93711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78
Jul 03 23:54:28 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:29 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78" returned: 0 in 1.048s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:54:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:29 devstack sudo[93726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 1G
Jul 03 23:54:29 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:30 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Flow 'volume_create_manager' (b0a3e566-c49b-40c7-bb50-1188c7c86b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a3e431-852a-4193-8828-277f102ad1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a3e431-852a-4193-8828-277f102ad1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1968347732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef2dfac3-43f9-430d-a74f-75fd109de61b,host='devstack@QuobyteHD#QuobyteHD',id=5d389de2-33e6-463d-bded-82afd150d041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c311e6287429c8c626eb987710e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:31Z,use_quota=True,user_id='7cf328da5b3d4fc9bdae9cee4075d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41d69f4d-02e9-4d22-aeca-b3f96b0ca91c),volume_type_id=41d69f4d-02e9-4d22-aeca-b3f96b0ca91c)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6222a408-1a41-4c70-8f84-48bee1e663e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6222a408-1a41-4c70-8f84-48bee1e663e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fb814b-b4f0-4dc5-b923-501ea6d3b511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fb814b-b4f0-4dc5-b923-501ea6d3b511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d389de2-33e6-463d-bded-82afd150d041', 'volume_name': 'volume-5d389de2-33e6-463d-bded-82afd150d041', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84143a03-9368-41f8-b05f-722bb9a079d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84143a03-9368-41f8-b05f-722bb9a079d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0556b17-16c9-4f6f-bd8d-0a0bdef785b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:30 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Volume 5d389de2-33e6-463d-bded-82afd150d041: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d389de2-33e6-463d-bded-82afd150d041', 'volume_size': 1}
Jul 03 23:54:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:31 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 1G" returned: 0 in 1.362s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:31 devstack sudo[93760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92
Jul 03 23:54:31 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-95ed17b8-a557-4a6a-b5f3-a203af43d125 req-7817e939-b598-4382-841b-b90a69bdcd7e tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:32 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92" returned: 0 in 0.923s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:32 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 is being set with open permissions: ugo+rw
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:32 devstack sudo[93783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92
Jul 03 23:54:32 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:32 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92" returned: 0 in 0.740s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.181s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.238s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ef2dfac3-43f9-430d-a74f-75fd109de61b,created_at=2026-07-03T21:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1968347732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ef2dfac3-43f9-430d-a74f-75fd109de61b,host='devstack@QuobyteHD#QuobyteHD',id=5d389de2-33e6-463d-bded-82afd150d041,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c311e6287429c8c626eb987710e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:31Z,use_quota=True,user_id='7cf328da5b3d4fc9bdae9cee4075d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41d69f4d-02e9-4d22-aeca-b3f96b0ca91c),volume_type_id=41d69f4d-02e9-4d22-aeca-b3f96b0ca91c)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Creating volume 5d389de2-33e6-463d-bded-82afd150d041 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:32 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:54:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:32 devstack sudo[93794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041 1073741824
Jul 03 23:54:32 devstack sudo[93794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:33 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-7094b688-3b6b-452a-9ed9-c0e77fda30ac tempest-VolumesSnapshotListTestJSON-1837009543 None] Create snapshot completed successfully
Jul 03 23:54:33 devstack sudo[93794]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041 1073741824" returned: 0 in 0.955s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:34 devstack sudo[93826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041
Jul 03 23:54:34 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:34 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041" returned: 0 in 0.823s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-95ed17b8-a557-4a6a-b5f3-a203af43d125 req-7817e939-b598-4382-841b-b90a69bdcd7e tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.846s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0556b17-16c9-4f6f-bd8d-0a0bdef785b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d389de2-33e6-463d-bded-82afd150d041', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40da3cd2-e077-4316-a3c5-4aeedf07224d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:34 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74222dd-e5e4-4bba-9311-58e7aabedf6c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-95ed17b8-a557-4a6a-b5f3-a203af43d125 req-7817e939-b598-4382-841b-b90a69bdcd7e tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:34 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Volume volume-5d389de2-33e6-463d-bded-82afd150d041 (5d389de2-33e6-463d-bded-82afd150d041): created successfully
Jul 03 23:54:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40da3cd2-e077-4316-a3c5-4aeedf07224d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Flow 'volume_create_manager' (b0a3e566-c49b-40c7-bb50-1188c7c86b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-978aa4d1-f470-4c2a-9436-c63a8091fbdf tempest-GroupSnapshotsTest-1139627404 None] Created volume successfully.
Jul 03 23:54:34 devstack sudo[93849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01
Jul 03 23:54:34 devstack sudo[93849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:35 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d2e83fce-d98e-40fc-93fe-263304d4f676 tempest-GroupSnapshotsTest-1139627404 None] Update group completed successfully.
Jul 03 23:54:35 devstack sudo[93849]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-95ed17b8-a557-4a6a-b5f3-a203af43d125 req-7817e939-b598-4382-841b-b90a69bdcd7e tempest-AttachVolumeTestJSON-1926062192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01" returned: 0 in 0.864s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-95ed17b8-a557-4a6a-b5f3-a203af43d125 req-7817e939-b598-4382-841b-b90a69bdcd7e tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.900s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.528s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] Creating offline snapshot 42810ce4-05ea-4b2e-8c6c-d95ecae6743c of volume 1010ffb6-d8b4-46de-83d3-e5c1a269b550 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:54:35 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cf765e-d111-4c7d-b8e3-6e2baa2cd667]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-95ed17b8-a557-4a6a-b5f3-a203af43d125 req-7817e939-b598-4382-841b-b90a69bdcd7e tempest-AttachVolumeTestJSON-1926062192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-3e713a76-d779-4cfd-8b56-3042c7f46c01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da4a1296-a3bc-46aa-a95b-82e6b513170d', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:54:35 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-95ed17b8-a557-4a6a-b5f3-a203af43d125 req-7817e939-b598-4382-841b-b90a69bdcd7e tempest-AttachVolumeTestJSON-1926062192 None] attachment_update completed successfully.
Jul 03 23:54:35 devstack sudo[93873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92
Jul 03 23:54:35 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:37 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9bf3bcf4-cf78-4548-b943-093debb97310 tempest-GroupSnapshotsTest-1139627404 None] Update group completed successfully.
Jul 03 23:54:37 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92" returned: 0 in 1.384s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:54:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:37 devstack sudo[93925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c 1G
Jul 03 23:54:37 devstack sudo[93925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1fc8344a-d24e-4c0e-9a8e-1ec702e88e18 tempest-GroupSnapshotsTest-1139627404 None] Update group completed successfully.
Jul 03 23:54:38 devstack sudo[93925]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c 1G" returned: 0 in 1.206s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:38 devstack sudo[93952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c
Jul 03 23:54:38 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:39 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c" returned: 0 in 0.889s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:39 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c is being set with open permissions: ugo+rw
Jul 03 23:54:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:39 devstack sudo[93960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c
Jul 03 23:54:39 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4c170f70-1944-4142-ad39-f050dba8ea4c tempest-GroupSnapshotsTest-1139627404 None] Update group completed successfully.
Jul 03 23:54:40 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c" returned: 0 in 0.858s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.462s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:40 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c138c33a-daa9-4741-a8b1-7fccfd24951b tempest-VolumesSnapshotListTestJSON-1837009543 None] Create snapshot completed successfully
Jul 03 23:54:41 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] GroupSnapshot 1dcd23db-3b12-490f-912b-ade5e818c521: creating.
Jul 03 23:54:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Group snapshot 1dcd23db-3b12-490f-912b-ade5e818c521: creating. {{(pid=86648) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 23:54:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Creating offline snapshot 82046adf-d2f3-44e9-b7e7-51449b240bc4 of volume 5d389de2-33e6-463d-bded-82afd150d041 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:54:41 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a03db7e-ae8f-40f2-bc7e-37b4ac754235]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:41 devstack sudo[93967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041
Jul 03 23:54:41 devstack sudo[93967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "cinder-42810ce4-05ea-4b2e-8c6c-d95ecae6743c-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-42810ce4-05ea-4b2e-8c6c-d95ecae6743c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "cinder-quobyte-1010ffb6-d8b4-46de-83d3-e5c1a269b550" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-1010ffb6-d8b4-46de-83d3-e5c1a269b550" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "cinder-quobyte-42810ce4-05ea-4b2e-8c6c-d95ecae6743c" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-42810ce4-05ea-4b2e-8c6c-d95ecae6743c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Deleting offline snapshot 42810ce4-05ea-4b2e-8c6c-d95ecae6743c of volume 1010ffb6-d8b4-46de-83d3-e5c1a269b550 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:54:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] snapshot_file for this snap is: volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:54:42 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eda76ee-603d-41b2-8c67-17bf3c2b37fe]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:43 devstack sudo[93971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c
Jul 03 23:54:43 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:43 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-95625d8e-faeb-40fb-9632-ac8cefd55acc req-c95c1103-4e60-49ea-91b3-3695951ae1a0 tempest-AttachVolumeTestJSON-1926062192 None] Terminate volume connection completed successfully.
Jul 03 23:54:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-95625d8e-faeb-40fb-9632-ac8cefd55acc req-c95c1103-4e60-49ea-91b3-3695951ae1a0 tempest-AttachVolumeTestJSON-1926062192 None] Deleting attachment fdc33393-cf46-4f6d-90a0-dd0947e7ee3d. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:54:43 devstack sudo[93967]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041" returned: 0 in 1.549s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:43 devstack sudo[93977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4 1G
Jul 03 23:54:43 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:44 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c" returned: 0 in 1.823s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:54:44 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0fa3ab-76b1-49b5-91f4-d238c04f884c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:44 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4 1G" returned: 0 in 1.554s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d389de2-33e6-463d-bded-82afd150d041 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:44 devstack sudo[93988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d389de2-33e6-463d-bded-82afd150d041 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4
Jul 03 23:54:44 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:45 devstack sudo[93987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92
Jul 03 23:54:45 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:45 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92" returned: 0 in 1.176s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:54:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:46 devstack sudo[93997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c
Jul 03 23:54:46 devstack sudo[93997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:46 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d389de2-33e6-463d-bded-82afd150d041 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4" returned: 0 in 1.384s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:46 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:54:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:46 devstack sudo[94002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4
Jul 03 23:54:46 devstack sudo[94002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:46 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-d9518ef5-0aeb-467b-ab03-c61893630216 req-cc749df2-c8f6-4e39-ae67-4b259a6a122a tempest-AttachVolumeTestJSON-1926062192 None] Terminate volume connection completed successfully.
Jul 03 23:54:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-d9518ef5-0aeb-467b-ab03-c61893630216 req-cc749df2-c8f6-4e39-ae67-4b259a6a122a tempest-AttachVolumeTestJSON-1926062192 None] Deleting attachment da4a1296-a3bc-46aa-a95b-82e6b513170d. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:54:46 devstack sudo[94002]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4" returned: 0 in 0.763s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:47 devstack sudo[94014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.info
Jul 03 23:54:47 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:47 devstack sudo[93997]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c" returned: 0 in 1.166s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:47 devstack sudo[94016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c
Jul 03 23:54:47 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:47 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.info" returned: 0 in 0.788s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:47 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:54:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:47 devstack sudo[94020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.info
Jul 03 23:54:47 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:47 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.42810ce4-05ea-4b2e-8c6c-d95ecae6743c" returned: 0 in 0.836s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-42810ce4-05ea-4b2e-8c6c-d95ecae6743c" released by "_delete_snapshot" :: held 5.172s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-1010ffb6-d8b4-46de-83d3-e5c1a269b550" released by "delete_snapshot" :: held 5.213s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:48 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Created reservations ['d871a09d-2e89-4959-a6ff-242918466022', '757b13fc-1ff9-414e-a74c-9451a361ff4e', 'ca23349a-cb7a-4d13-b51d-c5922f84397d', '613f7ea7-9799-4fe8-9696-3e4f2fbf7789'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Delete snapshot completed successfully.
Jul 03 23:54:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9ddb0458-3e31-42c1-8376-9a7e5e30f11f tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-42810ce4-05ea-4b2e-8c6c-d95ecae6743c-delete_snapshot" released by "delete_snapshot" :: held 5.449s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:48 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.info" returned: 0 in 0.764s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.993s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Creating offline snapshot eaca40cd-e514-416c-8c1d-29620b3799ed of volume 63e5872a-77e5-4626-b491-e248fed7b41d {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:54:48 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b51d9b5-3d09-4e27-93df-690e05664cfd]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:48 devstack sudo[94031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d
Jul 03 23:54:48 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "cinder-8ff7b645-a477-4a19-a52e-7f1a4b8c3c92-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-8ff7b645-a477-4a19-a52e-7f1a4b8c3c92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "cinder-quobyte-1010ffb6-d8b4-46de-83d3-e5c1a269b550" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-1010ffb6-d8b4-46de-83d3-e5c1a269b550" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "cinder-quobyte-8ff7b645-a477-4a19-a52e-7f1a4b8c3c92" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-8ff7b645-a477-4a19-a52e-7f1a4b8c3c92" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Deleting offline snapshot 8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 of volume 1010ffb6-d8b4-46de-83d3-e5c1a269b550 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:54:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] snapshot_file for this snap is: volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:54:49 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[96561c86-6c38-44b1-8f02-f5d36cc07af6]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:49 devstack sudo[94034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92
Jul 03 23:54:49 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:49 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d" returned: 0 in 0.884s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:49 devstack sudo[94039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed 1G
Jul 03 23:54:49 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:50 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92" returned: 0 in 0.994s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:54:50 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[892a1b38-a91c-48c3-8b80-b30af1411fb4]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:50 devstack sudo[94084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78
Jul 03 23:54:50 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:50 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed 1G" returned: 0 in 1.051s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e5872a-77e5-4626-b491-e248fed7b41d -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:50 devstack sudo[94091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e5872a-77e5-4626-b491-e248fed7b41d -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed
Jul 03 23:54:50 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:51 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78" returned: 0 in 1.127s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:54:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:51 devstack sudo[94112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92
Jul 03 23:54:51 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:51 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63e5872a-77e5-4626-b491-e248fed7b41d -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed" returned: 0 in 0.950s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:51 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:54:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:51 devstack sudo[94114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed
Jul 03 23:54:51 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:52 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:52 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed" returned: 0 in 0.914s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92" returned: 0 in 1.044s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:52 devstack sudo[94144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92
Jul 03 23:54:52 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:52 devstack sudo[94146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.info
Jul 03 23:54:52 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:53 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.info" returned: 0 in 0.782s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:53 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:54:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:53 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.8ff7b645-a477-4a19-a52e-7f1a4b8c3c92" returned: 0 in 0.835s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:53 devstack sudo[94151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.info
Jul 03 23:54:53 devstack sudo[94151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-8ff7b645-a477-4a19-a52e-7f1a4b8c3c92" released by "_delete_snapshot" :: held 4.129s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-1010ffb6-d8b4-46de-83d3-e5c1a269b550" released by "delete_snapshot" :: held 4.153s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:53 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Created reservations ['744b5a0a-1386-48f0-b22c-2c86d4655ae9', '35530e15-d295-4699-93b2-61aa5f49426a', 'dc8b0dfb-7345-4369-b723-27ec8b5fc3c3', 'bd40058d-5adf-439f-9d1c-931dbc93f68c'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:53 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Delete snapshot completed successfully.
Jul 03 23:54:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-35940291-6c2d-4019-ab43-2058d4bc765c tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-8ff7b645-a477-4a19-a52e-7f1a4b8c3c92-delete_snapshot" released by "delete_snapshot" :: held 4.323s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:54 devstack sudo[94151]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.info" returned: 0 in 0.821s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.590s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:54 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4ddf73a2-4a64-4a30-b385-09b9891081aa tempest-GroupSnapshotsTest-1139627404 None] group_snapshot 1dcd23db-3b12-490f-912b-ade5e818c521: created successfully
Jul 03 23:54:54 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] group_snapshot 1dcd23db-3b12-490f-912b-ade5e818c521: deleting
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] group_snapshot 1dcd23db-3b12-490f-912b-ade5e818c521: deleting {{(pid=86648) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-5d389de2-33e6-463d-bded-82afd150d041" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "cinder-fb54961a-4ce6-4fa0-8aa3-289084473d78-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-5d389de2-33e6-463d-bded-82afd150d041" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-82046adf-d2f3-44e9-b7e7-51449b240bc4" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-fb54961a-4ce6-4fa0-8aa3-289084473d78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "cinder-quobyte-1010ffb6-d8b4-46de-83d3-e5c1a269b550" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-82046adf-d2f3-44e9-b7e7-51449b240bc4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Deleting offline snapshot 82046adf-d2f3-44e9-b7e7-51449b240bc4 of volume 5d389de2-33e6-463d-bded-82afd150d041 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] snapshot_file for this snap is: volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-1010ffb6-d8b4-46de-83d3-e5c1a269b550" acquired by "delete_snapshot" :: waited 0.091s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "cinder-quobyte-fb54961a-4ce6-4fa0-8aa3-289084473d78" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8057a40f-5fb3-46d2-b96d-bafc66203cc3]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-fb54961a-4ce6-4fa0-8aa3-289084473d78" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Deleting offline snapshot fb54961a-4ce6-4fa0-8aa3-289084473d78 of volume 1010ffb6-d8b4-46de-83d3-e5c1a269b550 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] snapshot_file for this snap is: volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f93bce-b70e-43dd-9244-124842163e56]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:55 devstack sudo[94154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4
Jul 03 23:54:55 devstack sudo[94154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:55 devstack sudo[94155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78
Jul 03 23:54:55 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Flow 'volume_create_manager' (dc026b40-09aa-45b1-80d9-578add008f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c63c74c-86b9-4973-bc9c-890b5315b6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c63c74c-86b9-4973-bc9c-890b5315b6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1670966187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d6df63-732e-430c-93c3-e04ae6d446b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d218479a587d430eb9f8488fab978461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:55Z,use_quota=True,user_id='fbfd39f26ecb4460a6f0a84b84fbff4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44851f2-a02c-4b75-9665-4e4f69e2a14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44851f2-a02c-4b75-9665-4e4f69e2a14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5901be25-b8fa-4774-b798-f555f4a96f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5901be25-b8fa-4774-b798-f555f4a96f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98d6df63-732e-430c-93c3-e04ae6d446b9', 'volume_name': 'volume-98d6df63-732e-430c-93c3-e04ae6d446b9', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc968f2-c58b-460d-9138-6dc3d1e0b0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cc968f2-c58b-460d-9138-6dc3d1e0b0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559e0819-6432-4792-b77d-bed7c9083d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:55 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Volume 98d6df63-732e-430c-93c3-e04ae6d446b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98d6df63-732e-430c-93c3-e04ae6d446b9', 'volume_size': 1}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1670966187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d6df63-732e-430c-93c3-e04ae6d446b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d218479a587d430eb9f8488fab978461',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:55Z,use_quota=True,user_id='fbfd39f26ecb4460a6f0a84b84fbff4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Creating volume 98d6df63-732e-430c-93c3-e04ae6d446b9 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:55 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:54:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-98d6df63-732e-430c-93c3-e04ae6d446b9 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:55 devstack sudo[94158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-98d6df63-732e-430c-93c3-e04ae6d446b9 1073741824
Jul 03 23:54:55 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:56 devstack sudo[94154]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4" returned: 0 in 1.233s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d389de2-33e6-463d-bded-82afd150d041(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:54:56 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[19126918-fdec-4c71-ae14-4df6777c4c71]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:56 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78" returned: 0 in 1.180s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:54:56 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fd0014-a267-4e0c-9e1a-7a06f149f80c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:56 devstack sudo[94168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041
Jul 03 23:54:56 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:56 devstack sudo[94170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550
Jul 03 23:54:56 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:56 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-98d6df63-732e-430c-93c3-e04ae6d446b9 1073741824" returned: 0 in 1.350s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-98d6df63-732e-430c-93c3-e04ae6d446b9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:57 devstack sudo[94175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-98d6df63-732e-430c-93c3-e04ae6d446b9
Jul 03 23:54:57 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:57 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041" returned: 0 in 1.631s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:57 devstack sudo[94184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4
Jul 03 23:54:57 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:57 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550" returned: 0 in 1.629s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:57 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78
Jul 03 23:54:57 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "cinder-3e713a76-d779-4cfd-8b56-3042c7f46c01-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Lock "cinder-3e713a76-d779-4cfd-8b56-3042c7f46c01-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "cinder-quobyte-3e713a76-d779-4cfd-8b56-3042c7f46c01" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Lock "cinder-quobyte-3e713a76-d779-4cfd-8b56-3042c7f46c01" acquired by "delete_volume" :: waited 0.055s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cad5e8-75b7-45d9-b854-850aac06e0ea]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:58 devstack sudo[94189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01
Jul 03 23:54:58 devstack sudo[94189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:58 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-98d6df63-732e-430c-93c3-e04ae6d446b9" returned: 0 in 1.723s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] <== create_volume: return (3141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.151s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (559e0819-6432-4792-b77d-bed7c9083d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d6df63-732e-430c-93c3-e04ae6d446b9', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208ea173-bc25-448f-958b-6988b9e36e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:58 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Volume volume-98d6df63-732e-430c-93c3-e04ae6d446b9 (98d6df63-732e-430c-93c3-e04ae6d446b9): created successfully
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (208ea173-bc25-448f-958b-6988b9e36e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Flow 'volume_create_manager' (dc026b40-09aa-45b1-80d9-578add008f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:58 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5112665f-18a5-46d5-b5c6-84a347981b8b tempest-ServerRescueNegativeTestJSON-2011625555 None] Created volume successfully.
Jul 03 23:54:58 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78" returned: 0 in 1.034s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:58 devstack sudo[94194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78
Jul 03 23:54:58 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:59 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4" returned: 0 in 1.379s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:59 devstack sudo[94200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4
Jul 03 23:54:59 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:59 devstack sudo[94189]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01" returned: 0 in 1.248s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:59 devstack sudo[94205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01
Jul 03 23:54:59 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:59 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550.fb54961a-4ce6-4fa0-8aa3-289084473d78" returned: 0 in 1.080s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-fb54961a-4ce6-4fa0-8aa3-289084473d78" released by "_delete_snapshot" :: held 5.098s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-1010ffb6-d8b4-46de-83d3-e5c1a269b550" released by "delete_snapshot" :: held 5.159s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Created reservations ['da54e516-ccb4-4d92-967b-2f70106da8b2', 'b5c43335-b8b0-4cf7-82f7-9325109e456d', '4259a076-d5e5-48d1-8a7e-e57ae0efa722', '1206afe6-1969-40bd-9232-becd9cfe750d'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:00 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Delete snapshot completed successfully.
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-55567ae4-9b8c-47c2-99c1-37978d691d95 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-fb54961a-4ce6-4fa0-8aa3-289084473d78-delete_snapshot" released by "delete_snapshot" :: held 5.487s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:00 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041.82046adf-d2f3-44e9-b7e7-51449b240bc4" returned: 0 in 1.193s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-82046adf-d2f3-44e9-b7e7-51449b240bc4" released by "_delete_snapshot" :: held 5.599s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-5d389de2-33e6-463d-bded-82afd150d041" released by "delete_snapshot" :: held 5.643s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-63e5872a-77e5-4626-b491-e248fed7b41d" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-63e5872a-77e5-4626-b491-e248fed7b41d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-eaca40cd-e514-416c-8c1d-29620b3799ed" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-eaca40cd-e514-416c-8c1d-29620b3799ed" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Deleting offline snapshot eaca40cd-e514-416c-8c1d-29620b3799ed of volume 63e5872a-77e5-4626-b491-e248fed7b41d {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] snapshot_file for this snap is: volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1061bb-75b1-4b5d-836a-4721b6587907]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "cinder-1010ffb6-d8b4-46de-83d3-e5c1a269b550-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-1010ffb6-d8b4-46de-83d3-e5c1a269b550-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:00 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3e713a76-d779-4cfd-8b56-3042c7f46c01" returned: 0 in 1.095s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Lock "cinder-quobyte-3e713a76-d779-4cfd-8b56-3042c7f46c01" released by "delete_volume" :: held 2.430s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "cinder-quobyte-1010ffb6-d8b4-46de-83d3-e5c1a269b550" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:00 devstack sudo[94212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed
Jul 03 23:55:00 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-1010ffb6-d8b4-46de-83d3-e5c1a269b550" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d88ff62-e53e-48c3-bb17-7c92a2770d05]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Created reservations ['8753d3df-43ff-4340-9acb-666ff37def5d', '36aafd48-b119-4def-9aa8-4d5efcda75a0', 'e0702bf9-d344-420f-b60d-887986327753', '2f5f9dec-acff-4c1f-a8fc-1b7fd2ad92b2'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:00 devstack sudo[94214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550
Jul 03 23:55:00 devstack sudo[94214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:00 devstack sudo[94216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:01 devstack sudo[94216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "cinder-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Lock "cinder-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:01 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed" returned: 0 in 1.351s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63e5872a-77e5-4626-b491-e248fed7b41d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:55:01 devstack sudo[94214]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550" returned: 0 in 1.158s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:01 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87964b5-56ab-4c74-bcc7-278341058f33]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:01 devstack sudo[94228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550
Jul 03 23:55:01 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "cinder-quobyte-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Lock "cinder-quobyte-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:02 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2308e63c-59cd-4ad4-98dc-2182c15ef7e6]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:02 devstack sudo[94229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d
Jul 03 23:55:02 devstack sudo[94229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:02 devstack sudo[94216]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.386s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:02 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:02 devstack sudo[94231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9
Jul 03 23:55:02 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:02 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Deleted volume successfully.
Jul 03 23:55:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e14a9dbc-c45b-4807-99ff-42d353a3f0c2 tempest-AttachVolumeTestJSON-1926062192 None] Lock "cinder-3e713a76-d779-4cfd-8b56-3042c7f46c01-delete_volume" released by "delete_volume" :: held 4.266s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:03 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1010ffb6-d8b4-46de-83d3-e5c1a269b550" returned: 0 in 1.144s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-quobyte-1010ffb6-d8b4-46de-83d3-e5c1a269b550" released by "delete_volume" :: held 2.357s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Created reservations ['a9c331a0-617f-401e-b10c-93bee31c7f7e', 'c75e8e94-a1ba-48c9-8c05-4ca333f37389', '6fdac231-a508-40c8-bb24-baa68193a162', 'a729b95f-7067-4dd5-a99f-fa79de8609f9'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:03 devstack sudo[94229]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d" returned: 0 in 1.291s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:03 devstack sudo[94243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed
Jul 03 23:55:03 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:03 devstack sudo[94245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:03 devstack sudo[94245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:03 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9" returned: 0 in 1.334s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:03 devstack sudo[94247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9
Jul 03 23:55:03 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:04 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed" returned: 0 in 1.303s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:04 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:04 devstack sudo[94245]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9" returned: 0 in 1.185s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:04 devstack sudo[94481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed
Jul 03 23:55:04 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.290s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:04 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:04 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Deleted volume successfully.
Jul 03 23:55:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Lock "cinder-quobyte-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9" released by "delete_volume" :: held 2.628s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ac1a831d-bdc8-438d-8593-e1d56cea4a13 tempest-VolumesSnapshotListTestJSON-1837009543 None] Lock "cinder-1010ffb6-d8b4-46de-83d3-e5c1a269b550-delete_volume" released by "delete_volume" :: held 4.038s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:04 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Created reservations ['b7c8359d-1a82-4d41-b9d0-a88b1867a9e1', 'c94c753f-524a-470a-a6ca-4f5ba02cf3ff', 'ed8acf11-d134-4b26-8c1e-2f14e0ac1cb5', 'd2de175b-c2c6-441f-939a-8ac46abfeb2b'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:05 devstack sudo[94581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:05 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:05 devstack sudo[94593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:05 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "cinder-b1639d49-2d2c-4ab7-9756-a6977ba09c6e-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Lock "cinder-b1639d49-2d2c-4ab7-9756-a6977ba09c6e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "cinder-quobyte-b1639d49-2d2c-4ab7-9756-a6977ba09c6e" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Lock "cinder-quobyte-b1639d49-2d2c-4ab7-9756-a6977ba09c6e" acquired by "delete_volume" :: waited 0.069s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[797e03ce-6b2e-4f92-aed4-827517d3b032]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:06 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d.eaca40cd-e514-416c-8c1d-29620b3799ed" returned: 0 in 1.630s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-eaca40cd-e514-416c-8c1d-29620b3799ed" released by "_delete_snapshot" :: held 5.756s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-63e5872a-77e5-4626-b491-e248fed7b41d" released by "delete_snapshot" :: held 5.826s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:06 devstack sudo[94626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e
Jul 03 23:55:06 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:06 devstack cinder-volume[86648]: WARNING cinder.quota [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1695370153 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1695370153, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:55:06 devstack cinder-volume[86648]: WARNING cinder.quota [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1695370153 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1695370153, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['4b52e718-0155-421e-b6df-4110f78173ce', 'b9e9d271-4443-488e-a300-09ca246365f9', 'dac38c23-a204-4172-897c-9a987b892d3b', '0e480ffe-6e59-46d2-8ce1-440ee64ef3d4'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:06 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.762s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 8 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:55:06 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['f8c1c5c3-7c26-4ab8-8c65-43261a2a45c7', '66ffc1c9-51b6-4e0d-86bc-d066495b13cc', '340e02b8-2566-440d-8e67-82e1c92e89ca', 'd2cf5130-dde4-432f-b6ab-f25f53b98d33'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:07 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.936s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:07 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:07 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Deleted volume successfully.
Jul 03 23:55:07 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9f909c27-3e57-48a6-8724-069df96924fb tempest-GroupSnapshotsTest-1139627404 None] group_snapshot 1dcd23db-3b12-490f-912b-ade5e818c521: deleted successfully
Jul 03 23:55:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a9621f72-7c35-4c3f-80a4-7303490219a2 tempest-AttachVolumeTestJSON-1926062192 None] Lock "cinder-62b00a4f-5a72-4dc3-a8ac-165d9c012bf9-delete_volume" released by "delete_volume" :: held 5.139s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:07 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e" returned: 0 in 1.562s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:07 devstack sudo[94670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e
Jul 03 23:55:07 devstack sudo[94670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-5d389de2-33e6-463d-bded-82afd150d041" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-5d389de2-33e6-463d-bded-82afd150d041" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bd6ec8-2fdd-4884-ba6d-9952447cb2eb]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:07 devstack sudo[94674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041
Jul 03 23:55:07 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:08 devstack sudo[94670]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b1639d49-2d2c-4ab7-9756-a6977ba09c6e" returned: 0 in 0.704s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Lock "cinder-quobyte-b1639d49-2d2c-4ab7-9756-a6977ba09c6e" released by "delete_volume" :: held 2.390s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:08 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Created reservations ['3a5a2905-fbfd-48a5-b0aa-a0b68609f253', 'b81af7ba-43cf-437e-9fd9-4900ef02f897', '786fea80-4cd2-4a4e-b9bb-9957988ce36a', '526627d4-1aca-4ed6-a49e-042b6d3df1f7'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:08 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:08 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:08 devstack sudo[94677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:08 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:08 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041" returned: 0 in 0.875s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:08 devstack sudo[94682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041
Jul 03 23:55:08 devstack sudo[94682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:09 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.766s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Deleted volume successfully.
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d0f53d7a-a963-4cb9-a8ec-49e23736761f tempest-AttachVolumeTestJSON-1926062192 None] Lock "cinder-b1639d49-2d2c-4ab7-9756-a6977ba09c6e-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:09 devstack sudo[94682]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d389de2-33e6-463d-bded-82afd150d041" returned: 0 in 0.851s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-5d389de2-33e6-463d-bded-82afd150d041" released by "delete_volume" :: held 1.841s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-63e5872a-77e5-4626-b491-e248fed7b41d" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-63e5872a-77e5-4626-b491-e248fed7b41d" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[562bfc51-14da-40b3-9e28-fed06ba6d73b]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Flow 'volume_create_manager' (cdd2ae68-51d2-479b-af64-b9411b044589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31b31e2-6c0b-4e46-9545-17d9b7ae7985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e31b31e2-6c0b-4e46-9545-17d9b7ae7985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1930086438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4045ec9-5768-459e-b7c3-be6317474fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54517913944843859098d4d7494b4c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:10Z,use_quota=True,user_id='482f9528436f40428ef1a6f96b13f931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98edb29-9c09-44bf-9df5-6546e352be86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98edb29-9c09-44bf-9df5-6546e352be86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd7f1ee-4780-4781-a17c-8946292de74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd7f1ee-4780-4781-a17c-8946292de74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4045ec9-5768-459e-b7c3-be6317474fea', 'volume_name': 'volume-f4045ec9-5768-459e-b7c3-be6317474fea', 'volume_size': 2}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a25fe7-64ea-478c-9aaa-52fbe0716a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a25fe7-64ea-478c-9aaa-52fbe0716a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883e9c9d-7234-4537-8af3-3b8e9e66c629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:09 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Volume f4045ec9-5768-459e-b7c3-be6317474fea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4045ec9-5768-459e-b7c3-be6317474fea', 'volume_size': 2}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1930086438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4045ec9-5768-459e-b7c3-be6317474fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54517913944843859098d4d7494b4c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:10Z,use_quota=True,user_id='482f9528436f40428ef1a6f96b13f931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Creating volume f4045ec9-5768-459e-b7c3-be6317474fea {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:09 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:55:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea 2147483648 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:09 devstack sudo[94709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d
Jul 03 23:55:09 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:09 devstack sudo[94710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea 2147483648
Jul 03 23:55:09 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:10 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d" returned: 0 in 1.065s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:10 devstack sudo[94721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d
Jul 03 23:55:10 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:11 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea 2147483648" returned: 0 in 1.360s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:11 devstack sudo[94724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea
Jul 03 23:55:11 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:11 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-63e5872a-77e5-4626-b491-e248fed7b41d" returned: 0 in 1.071s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-63e5872a-77e5-4626-b491-e248fed7b41d" released by "delete_volume" :: held 2.231s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:11 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['18d26620-a9be-46da-b0e1-22dd33638e61'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:11 devstack cinder-volume[86648]: WARNING cinder.quota [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1695370153 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1695370153, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['da4d0176-bb74-4d0b-b669-e8a08fbe646f', '17c8f31e-452e-477e-baf8-d39cc5f8b677', '754212fb-0907-4ac7-b49e-5a258e0f133a', '58b3340a-a998-4650-9fea-e8b78f608978'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:12 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea" returned: 0 in 0.939s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] <== create_volume: return (2363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.366s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (883e9c9d-7234-4537-8af3-3b8e9e66c629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4045ec9-5768-459e-b7c3-be6317474fea', 'volume_size': 2}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fe887a-965b-4b36-ade2-dff744608caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:12 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Volume volume-f4045ec9-5768-459e-b7c3-be6317474fea (f4045ec9-5768-459e-b7c3-be6317474fea): created successfully
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fe887a-965b-4b36-ade2-dff744608caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Flow 'volume_create_manager' (cdd2ae68-51d2-479b-af64-b9411b044589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['9d7ac25f-8a7b-4d9a-9f25-f65cee6491a9', '1977a28f-f53e-44a9-aeae-2ed2b966db0f', '8d543656-9950-4583-9e27-e011b8b6a373', '1cd050a5-4c15-413a-b5d7-6171d6371726'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-11fddb55-2bc1-4fb6-bb98-352a837d5ed4 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Created volume successfully.
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:12 devstack sudo[94729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:12 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Creating offline snapshot a6ae0b7e-006e-4225-9299-164a0511f63c of volume f4045ec9-5768-459e-b7c3-be6317474fea {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:55:13 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fb43e6-1d81-4a71-bb2c-f80289fb9a6c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:13 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.358s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:13 devstack sudo[94733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea
Jul 03 23:55:13 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:13 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-743381b7-1790-42fc-b8de-af0213629353 tempest-GroupSnapshotsTest-1139627404 None] Delete group completed successfully.
Jul 03 23:55:14 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6b96ea6c-d964-49cb-9f82-2afbfdca8459 tempest-GroupSnapshotsTest-1139627404 None] Group tempest-GroupSnapshotsTest-Group-78723905: creating
Jul 03 23:55:14 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6b96ea6c-d964-49cb-9f82-2afbfdca8459 tempest-GroupSnapshotsTest-1139627404 None] Group tempest-GroupSnapshotsTest-Group-78723905: created successfully
Jul 03 23:55:14 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6b96ea6c-d964-49cb-9f82-2afbfdca8459 tempest-GroupSnapshotsTest-1139627404 None] Create group completed successfully.
Jul 03 23:55:15 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea" returned: 0 in 1.416s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c 2G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:15 devstack sudo[94824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c 2G
Jul 03 23:55:15 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Flow 'volume_create_manager' (0c1beadd-fcec-4dfc-9168-0c2d864a592d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c098e4dc-b403-4bad-9694-c570fa229118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c098e4dc-b403-4bad-9694-c570fa229118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-927838172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3130a3d5-0851-46bc-8413-94a4a0fb9711,host='devstack@QuobyteHD#QuobyteHD',id=a88b6a25-ef71-47ad-8ded-799914f1443f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c311e6287429c8c626eb987710e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:16Z,use_quota=True,user_id='7cf328da5b3d4fc9bdae9cee4075d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d4a8421-1744-4b76-ae5b-d3a7ef65cbc9),volume_type_id=1d4a8421-1744-4b76-ae5b-d3a7ef65cbc9)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48894b93-b599-486b-bd01-a38096b8e6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48894b93-b599-486b-bd01-a38096b8e6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c17464c-8a5b-4540-b6e8-db0f6fe25d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c17464c-8a5b-4540-b6e8-db0f6fe25d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a88b6a25-ef71-47ad-8ded-799914f1443f', 'volume_name': 'volume-a88b6a25-ef71-47ad-8ded-799914f1443f', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c8e8c8-1a1d-4eb8-824c-92439d9045c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3c8e8c8-1a1d-4eb8-824c-92439d9045c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ebe12e-172c-447c-84dd-9be5970d4e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:16 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Volume a88b6a25-ef71-47ad-8ded-799914f1443f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a88b6a25-ef71-47ad-8ded-799914f1443f', 'volume_size': 1}
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:16 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c 2G" returned: 0 in 1.597s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4045ec9-5768-459e-b7c3-be6317474fea -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:16 devstack sudo[94838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4045ec9-5768-459e-b7c3-be6317474fea -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c
Jul 03 23:55:16 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:17 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4045ec9-5768-459e-b7c3-be6317474fea -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c" returned: 0 in 0.842s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:17 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c is being set with open permissions: ugo+rw
Jul 03 23:55:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:17 devstack sudo[94863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c
Jul 03 23:55:17 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:18 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c" returned: 0 in 0.783s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:18 devstack sudo[94866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.info
Jul 03 23:55:18 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:19 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.info" returned: 0 in 0.877s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:19 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.info is being set with open permissions: ugo+rw
Jul 03 23:55:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:19 devstack sudo[94871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.info
Jul 03 23:55:19 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Acquiring lock "cinder-98d6df63-732e-430c-93c3-e04ae6d446b9-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Lock "cinder-98d6df63-732e-430c-93c3-e04ae6d446b9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Acquiring lock "cinder-quobyte-98d6df63-732e-430c-93c3-e04ae6d446b9" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Lock "cinder-quobyte-98d6df63-732e-430c-93c3-e04ae6d446b9" acquired by "delete_volume" :: waited 0.033s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:19 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76c9651-fea0-43db-bdd8-59604e75c2af]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-98d6df63-732e-430c-93c3-e04ae6d446b9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:19 devstack sudo[94873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-98d6df63-732e-430c-93c3-e04ae6d446b9
Jul 03 23:55:19 devstack sudo[94873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:20 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.info" returned: 0 in 0.828s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.551s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.588s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3130a3d5-0851-46bc-8413-94a4a0fb9711,created_at=2026-07-03T21:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-927838172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3130a3d5-0851-46bc-8413-94a4a0fb9711,host='devstack@QuobyteHD#QuobyteHD',id=a88b6a25-ef71-47ad-8ded-799914f1443f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d25c311e6287429c8c626eb987710e64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:16Z,use_quota=True,user_id='7cf328da5b3d4fc9bdae9cee4075d013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1d4a8421-1744-4b76-ae5b-d3a7ef65cbc9),volume_type_id=1d4a8421-1744-4b76-ae5b-d3a7ef65cbc9)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Creating volume a88b6a25-ef71-47ad-8ded-799914f1443f {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:20 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:20 devstack sudo[94877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f 1073741824
Jul 03 23:55:20 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:20 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6ede8fcf-41ad-449b-80e5-5dbe160431a2 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Create snapshot completed successfully
Jul 03 23:55:20 devstack sudo[94873]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-98d6df63-732e-430c-93c3-e04ae6d446b9" returned: 0 in 1.053s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-98d6df63-732e-430c-93c3-e04ae6d446b9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:20 devstack sudo[94882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-98d6df63-732e-430c-93c3-e04ae6d446b9
Jul 03 23:55:20 devstack sudo[94882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:20 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Flow 'volume_create_manager' (8a0744e7-b8e5-4fb4-a9d1-018aaabd3abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cd55e2-2afa-47f3-a027-b7e0d991e79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72cd55e2-2afa-47f3-a027-b7e0d991e79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2019801492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fdb843f-608a-4a55-a36a-e3b0182dcceb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='869bd15a226244b48b9a610e2310d3bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:21Z,use_quota=True,user_id='9cc0de5efe0147b09296bbf49972f286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72acd5c-38e5-4afe-a869-5cf305ee1355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72acd5c-38e5-4afe-a869-5cf305ee1355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01618f6b-a6cf-4b5f-b272-5a4d034acc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01618f6b-a6cf-4b5f-b272-5a4d034acc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fdb843f-608a-4a55-a36a-e3b0182dcceb', 'volume_name': 'volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b2d59b-6332-4414-b5a9-f71aca4352eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b2d59b-6332-4414-b5a9-f71aca4352eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c604e2-2d22-4159-840f-110fb9b0aba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:21 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Volume 4fdb843f-608a-4a55-a36a-e3b0182dcceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb', 'volume_size': 1}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Acquiring lock "cinder-a6ae0b7e-006e-4225-9299-164a0511f63c-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "cinder-a6ae0b7e-006e-4225-9299-164a0511f63c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Acquiring lock "cinder-quobyte-f4045ec9-5768-459e-b7c3-be6317474fea" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "cinder-quobyte-f4045ec9-5768-459e-b7c3-be6317474fea" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Acquiring lock "cinder-quobyte-a6ae0b7e-006e-4225-9299-164a0511f63c" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "cinder-quobyte-a6ae0b7e-006e-4225-9299-164a0511f63c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Deleting offline snapshot a6ae0b7e-006e-4225-9299-164a0511f63c of volume f4045ec9-5768-459e-b7c3-be6317474fea {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] snapshot_file for this snap is: volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3989f014-a97c-454a-924d-b6ae6b2f448a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:21 devstack sudo[94888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c
Jul 03 23:55:21 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:21 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f 1073741824" returned: 0 in 1.486s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:21 devstack sudo[94891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f
Jul 03 23:55:21 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:21 devstack sudo[94882]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-98d6df63-732e-430c-93c3-e04ae6d446b9" returned: 0 in 1.176s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Lock "cinder-quobyte-98d6df63-732e-430c-93c3-e04ae6d446b9" released by "delete_volume" :: held 2.317s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Created reservations ['64a53720-8b49-416c-a3ba-012d07f50b9e', '9a8d244c-a749-4f2a-bd17-e7e418e871f7', 'c8e4d6cb-836d-47df-b2a3-fadd57703ee4', 'b69f4416-59a0-417a-989e-6c0b3e65fad0'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:21 devstack sudo[94893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:21 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:22 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c" returned: 0 in 1.053s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4045ec9-5768-459e-b7c3-be6317474fea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[565f0592-b46e-450e-abac-bc2a278903f1]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:22 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f" returned: 0 in 0.802s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] <== create_volume: return (2385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.392s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.299s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2019801492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fdb843f-608a-4a55-a36a-e3b0182dcceb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='869bd15a226244b48b9a610e2310d3bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:21Z,use_quota=True,user_id='9cc0de5efe0147b09296bbf49972f286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Creating volume 4fdb843f-608a-4a55-a36a-e3b0182dcceb {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:22 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:22 devstack sudo[94899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea
Jul 03 23:55:22 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:22 devstack sudo[94900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb 1073741824
Jul 03 23:55:22 devstack sudo[94900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4ebe12e-172c-447c-84dd-9be5970d4e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a88b6a25-ef71-47ad-8ded-799914f1443f', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bcfbfc-42cf-484b-8dbd-9e136e3d79cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:22 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Volume volume-a88b6a25-ef71-47ad-8ded-799914f1443f (a88b6a25-ef71-47ad-8ded-799914f1443f): created successfully
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5bcfbfc-42cf-484b-8dbd-9e136e3d79cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Flow 'volume_create_manager' (0c1beadd-fcec-4dfc-9168-0c2d864a592d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:22 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-269aa61b-c183-4c94-996e-ed9f0734a1bd tempest-GroupSnapshotsTest-1139627404 None] Created volume successfully.
Jul 03 23:55:22 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.944s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:22 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Deleted volume successfully.
Jul 03 23:55:22 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fa9381a8-2aa6-454a-ad5a-3da2c99a88ed tempest-ServerRescueNegativeTestJSON-2011625555 None] Lock "cinder-98d6df63-732e-430c-93c3-e04ae6d446b9-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:23 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] GroupSnapshot 53b9e003-b6b4-46d8-9b4a-a205ac033ebf: creating.
Jul 03 23:55:23 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=104,cinder:UPDATE=123,cinder:DELETE=8,cinder:INSERT=26 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:55:23 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:23 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=119,cinder:SELECT=124,cinder:INSERT=33,cinder:DELETE=7 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:55:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea" returned: 0 in 1.109s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] Group snapshot 53b9e003-b6b4-46d8-9b4a-a205ac033ebf: creating. {{(pid=86648) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 23:55:23 devstack sudo[94909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c
Jul 03 23:55:23 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:23 devstack sudo[94900]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb 1073741824" returned: 0 in 1.356s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:23 devstack sudo[94919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb
Jul 03 23:55:23 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:24 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c" returned: 0 in 0.759s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:24 devstack sudo[94926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c
Jul 03 23:55:24 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:24 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb" returned: 0 in 0.809s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.176s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c604e2-2d22-4159-840f-110fb9b0aba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e829dc09-928d-4cb5-bb42-fa3cd2d6b7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] Creating offline snapshot f87e6fe6-a2ef-4b2a-95de-81088e0c4c08 of volume a88b6a25-ef71-47ad-8ded-799914f1443f {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:55:24 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Volume volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb (4fdb843f-608a-4a55-a36a-e3b0182dcceb): created successfully
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e829dc09-928d-4cb5-bb42-fa3cd2d6b7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Flow 'volume_create_manager' (8a0744e7-b8e5-4fb4-a9d1-018aaabd3abe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0048e64c-64d6-4da6-8206-d2d2dac915b2]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:24 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-974d24a5-e581-4738-9a27-39456fef007d req-196b1840-290b-4a09-afa2-c2c9f6e7fd48 tempest-VolumesGetTestJSON-156168121 None] Created volume successfully.
Jul 03 23:55:25 devstack sudo[94935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f
Jul 03 23:55:25 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:25 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea.a6ae0b7e-006e-4225-9299-164a0511f63c" returned: 0 in 0.945s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "cinder-quobyte-a6ae0b7e-006e-4225-9299-164a0511f63c" released by "_delete_snapshot" :: held 3.998s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "cinder-quobyte-f4045ec9-5768-459e-b7c3-be6317474fea" released by "delete_snapshot" :: held 4.047s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:25 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Created reservations ['f8495c14-b6c4-4f6b-b375-d2b333a4f713', '3ef8eaa6-4b5e-495c-b9ab-b257327096db', '14781348-5d7d-4eff-9dc9-f702f4915cbb', '247af160-fb44-46f8-bba6-70c1104fb7f7'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:25 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Delete snapshot completed successfully.
Jul 03 23:55:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-44f44bad-688c-4951-bc0e-44ee20ed5471 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "cinder-a6ae0b7e-006e-4225-9299-164a0511f63c-delete_snapshot" released by "delete_snapshot" :: held 4.297s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Acquiring lock "cinder-f4045ec9-5768-459e-b7c3-be6317474fea-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "cinder-f4045ec9-5768-459e-b7c3-be6317474fea-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Acquiring lock "cinder-quobyte-f4045ec9-5768-459e-b7c3-be6317474fea" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "cinder-quobyte-f4045ec9-5768-459e-b7c3-be6317474fea" acquired by "delete_volume" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:25 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[71202745-6cab-492d-bc98-bd497380a81c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:26 devstack sudo[94958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea
Jul 03 23:55:26 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Acquiring lock "cinder-4fdb843f-608a-4a55-a36a-e3b0182dcceb-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Lock "cinder-4fdb843f-608a-4a55-a36a-e3b0182dcceb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Acquiring lock "cinder-quobyte-4fdb843f-608a-4a55-a36a-e3b0182dcceb" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:26 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Lock "cinder-quobyte-4fdb843f-608a-4a55-a36a-e3b0182dcceb" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f" returned: 0 in 1.727s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:26 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[25708b59-72a5-459d-8225-8e6594cec949]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:26 devstack sudo[94963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08 1G
Jul 03 23:55:26 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:26 devstack sudo[94964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb
Jul 03 23:55:26 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:27 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea" returned: 0 in 1.619s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:27 devstack sudo[94975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea
Jul 03 23:55:27 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:27 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08 1G" returned: 0 in 1.312s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a88b6a25-ef71-47ad-8ded-799914f1443f -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:27 devstack sudo[94981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a88b6a25-ef71-47ad-8ded-799914f1443f -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08
Jul 03 23:55:27 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:27 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb" returned: 0 in 1.315s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:27 devstack sudo[94983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb
Jul 03 23:55:27 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:28 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f4045ec9-5768-459e-b7c3-be6317474fea" returned: 0 in 1.163s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "cinder-quobyte-f4045ec9-5768-459e-b7c3-be6317474fea" released by "delete_volume" :: held 2.932s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:28 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4fdb843f-608a-4a55-a36a-e3b0182dcceb" returned: 0 in 0.996s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:28 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a88b6a25-ef71-47ad-8ded-799914f1443f -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08" returned: 0 in 1.047s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:28 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:55:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Lock "cinder-quobyte-4fdb843f-608a-4a55-a36a-e3b0182dcceb" released by "delete_volume" :: held 2.396s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:28 devstack sudo[94999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08
Jul 03 23:55:28 devstack sudo[94999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:28 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Created reservations ['6abb09ff-8fa0-4b9f-9861-b9abfdb47b93', '4e6c1ded-5a40-4caf-ae8d-8331c7c4cfef', '72879fa2-2fa7-4ff4-8bc6-97f6100b158a', '7b05540c-b84f-456e-a916-8886f63c05c9'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:28 devstack cinder-volume[86648]: DEBUG cinder.quota [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Created reservations ['79926fcd-3fe5-4402-bafc-f2a262fdd7aa', 'd856fd1f-2263-4aa4-b58f-052e1a0642c1', '91b99d9e-7a4e-40b5-bbe2-5b9f8edc1ffd', '525cacd3-eabb-4968-8199-fa98b9c46173'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:29 devstack sudo[95001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:29 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:29 devstack sudo[95003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:29 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:30 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.938s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:30 devstack cinder-volume[86648]: DEBUG cinder.manager [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:30 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Deleted volume successfully.
Jul 03 23:55:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-660fac6a-6066-43c5-a28f-78ef0f3eb988 req-4ef19470-12b5-4521-baa1-55dff358e4be tempest-VolumesGetTestJSON-156168121 None] Lock "cinder-4fdb843f-608a-4a55-a36a-e3b0182dcceb-delete_volume" released by "delete_volume" :: held 3.693s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:30 devstack sudo[94999]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08" returned: 0 in 1.274s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:30 devstack sudo[95008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.info
Jul 03 23:55:30 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:30 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.380s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:30 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:30 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Deleted volume successfully.
Jul 03 23:55:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f3de7158-ac8c-48a4-986a-2ad975547e67 tempest-VolumesSnapshotNegativeTestJSON-1577370991 None] Lock "cinder-f4045ec9-5768-459e-b7c3-be6317474fea-delete_volume" released by "delete_volume" :: held 4.723s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:31 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.info" returned: 0 in 1.165s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:31 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:55:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:31 devstack sudo[95013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.info
Jul 03 23:55:31 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:32 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.info" returned: 0 in 0.839s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.546s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-72d826f7-56ae-4c2c-9df2-771b3b9c67c5 tempest-GroupSnapshotsTest-1139627404 None] group_snapshot 53b9e003-b6b4-46d8-9b4a-a205ac033ebf: created successfully
Jul 03 23:55:33 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] group_snapshot 53b9e003-b6b4-46d8-9b4a-a205ac033ebf: deleting
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] group_snapshot 53b9e003-b6b4-46d8-9b4a-a205ac033ebf: deleting {{(pid=86648) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-a88b6a25-ef71-47ad-8ded-799914f1443f" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-a88b6a25-ef71-47ad-8ded-799914f1443f" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-f87e6fe6-a2ef-4b2a-95de-81088e0c4c08" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-f87e6fe6-a2ef-4b2a-95de-81088e0c4c08" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Deleting offline snapshot f87e6fe6-a2ef-4b2a-95de-81088e0c4c08 of volume a88b6a25-ef71-47ad-8ded-799914f1443f {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] snapshot_file for this snap is: volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[069db488-17ca-4bd0-b828-f0f3e45d0690]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Flow 'volume_create_manager' (dfd3aa1f-1920-465b-9b7f-4fb92c0bf1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c047e7-ac74-4b97-97d0-ad61015ffdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c047e7-ac74-4b97-97d0-ad61015ffdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1317404059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77713a19-2367-4b16-9207-917eab6fe6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b16fb3609af461499f96e7683a0b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:33Z,use_quota=True,user_id='7f27f2096247433da51d5dc5011e4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da447eb-dda8-4a14-8c01-e62d1fe92983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da447eb-dda8-4a14-8c01-e62d1fe92983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee1c1ed-b412-4f2e-9677-5bf48c4d4103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee1c1ed-b412-4f2e-9677-5bf48c4d4103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77713a19-2367-4b16-9207-917eab6fe6bf', 'volume_name': 'volume-77713a19-2367-4b16-9207-917eab6fe6bf', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd1ee74-8338-4ddf-904d-5481e4f4b6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd1ee74-8338-4ddf-904d-5481e4f4b6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40451e7-123f-476d-a26b-374558964d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:33 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Volume 77713a19-2367-4b16-9207-917eab6fe6bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77713a19-2367-4b16-9207-917eab6fe6bf', 'volume_size': 1}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1317404059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77713a19-2367-4b16-9207-917eab6fe6bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b16fb3609af461499f96e7683a0b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:33Z,use_quota=True,user_id='7f27f2096247433da51d5dc5011e4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Creating volume 77713a19-2367-4b16-9207-917eab6fe6bf {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:33 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-77713a19-2367-4b16-9207-917eab6fe6bf 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:33 devstack sudo[95016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08
Jul 03 23:55:33 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:33 devstack sudo[95017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-77713a19-2367-4b16-9207-917eab6fe6bf 1073741824
Jul 03 23:55:33 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:33 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Flow 'volume_create_manager' (c747beab-e7c2-4c41-bf76-4d188191bc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48adb5d1-3b39-415c-9531-d2c54f4d10a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48adb5d1-3b39-415c-9531-d2c54f4d10a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1016466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b16fb3609af461499f96e7683a0b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:34Z,use_quota=True,user_id='7f27f2096247433da51d5dc5011e4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939ad9cb-c233-4c80-9d11-d722c71b0dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939ad9cb-c233-4c80-9d11-d722c71b0dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcd68ab-8e75-43f5-9996-69a731a13191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dcd68ab-8e75-43f5-9996-69a731a13191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d', 'volume_name': 'volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c5b315-915c-43cb-94db-a098327b35c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58c5b315-915c-43cb-94db-a098327b35c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fbba17-7aa5-4fc9-b5e7-fe7fbfc3ecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:34 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Volume 6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d', 'volume_size': 1}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:34 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Flow 'volume_create_manager' (4beb1e6a-cc14-42a2-8920-9c3abdc4b76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8233e53d-d3d4-4bfa-a01f-e7d9506cd312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08" returned: 0 in 1.441s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a88b6a25-ef71-47ad-8ded-799914f1443f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5630a4b7-3fb2-4867-ad57-020391ee0f1a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8233e53d-d3d4-4bfa-a01f-e7d9506cd312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744181863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2266f838-c40d-45a7-b78a-05509b25fb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b16fb3609af461499f96e7683a0b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:35Z,use_quota=True,user_id='7f27f2096247433da51d5dc5011e4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfe6dc9-9019-414a-b05c-721a998aefdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cfe6dc9-9019-414a-b05c-721a998aefdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e4e527-a6f1-4952-98d7-66f58bbe8acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e4e527-a6f1-4952-98d7-66f58bbe8acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2266f838-c40d-45a7-b78a-05509b25fb66', 'volume_name': 'volume-2266f838-c40d-45a7-b78a-05509b25fb66', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9710660-acac-4df9-aa04-29ece9098a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9710660-acac-4df9-aa04-29ece9098a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10f6992-7305-486b-8a2c-29739c4347c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:35 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Volume 2266f838-c40d-45a7-b78a-05509b25fb66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2266f838-c40d-45a7-b78a-05509b25fb66', 'volume_size': 1}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:35 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-77713a19-2367-4b16-9207-917eab6fe6bf 1073741824" returned: 0 in 1.579s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-77713a19-2367-4b16-9207-917eab6fe6bf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:35 devstack sudo[95045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f
Jul 03 23:55:35 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:35 devstack sudo[95048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-77713a19-2367-4b16-9207-917eab6fe6bf
Jul 03 23:55:35 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Flow 'volume_create_manager' (24b0e002-05a6-4a8f-a373-cd413388f076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7cbde76-2d29-4504-85fa-5618ea11fc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7cbde76-2d29-4504-85fa-5618ea11fc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1409886329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1e0e44-7b42-4070-8055-53b4b95be98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b16fb3609af461499f96e7683a0b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:35Z,use_quota=True,user_id='7f27f2096247433da51d5dc5011e4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b655139f-1103-4bad-8e32-aa51bbb8c0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b655139f-1103-4bad-8e32-aa51bbb8c0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de856a76-09d2-4001-8172-c3ab7aba19c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de856a76-09d2-4001-8172-c3ab7aba19c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf1e0e44-7b42-4070-8055-53b4b95be98a', 'volume_name': 'volume-cf1e0e44-7b42-4070-8055-53b4b95be98a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7596c93-b0fd-491e-8b20-8046d722a682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7596c93-b0fd-491e-8b20-8046d722a682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d88035-8296-48a1-a96a-17618b6a1c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:35 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Volume cf1e0e44-7b42-4070-8055-53b4b95be98a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf1e0e44-7b42-4070-8055-53b4b95be98a', 'volume_size': 1}
Jul 03 23:55:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:36 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Flow 'volume_create_manager' (8191a137-6c85-452a-a3a5-afeec337ecec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb040da-e34b-4cd0-8a12-ef05bf272db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-77713a19-2367-4b16-9207-917eab6fe6bf" returned: 0 in 1.101s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] <== create_volume: return (2749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.752s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:36 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.295s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1016466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b16fb3609af461499f96e7683a0b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:34Z,use_quota=True,user_id='7f27f2096247433da51d5dc5011e4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Creating volume 6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:36 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f" returned: 0 in 1.450s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:36 devstack sudo[95058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d 1073741824
Jul 03 23:55:36 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb040da-e34b-4cd0-8a12-ef05bf272db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1589626501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399de603-6810-4812-90c8-27b0d574037b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c4b924b8fdc429f83433ce074ea1412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:36Z,use_quota=True,user_id='3c9d81bba98747129d985a56897911dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed35b3cf-0c07-4358-8872-06c6bdb73ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:36 devstack sudo[95059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08
Jul 03 23:55:36 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed35b3cf-0c07-4358-8872-06c6bdb73ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c365b0da-1e83-4851-baca-5fce37d2b4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c365b0da-1e83-4851-baca-5fce37d2b4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '399de603-6810-4812-90c8-27b0d574037b', 'volume_name': 'volume-399de603-6810-4812-90c8-27b0d574037b', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6fdb61-8378-4f83-822f-30bad1bdd5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6fdb61-8378-4f83-822f-30bad1bdd5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb70822-3ffb-42b0-8f88-b5dff07550bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:36 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Volume 399de603-6810-4812-90c8-27b0d574037b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-399de603-6810-4812-90c8-27b0d574037b', 'volume_size': 1}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Flow 'volume_create_manager' (824421bd-3c34-4198-a71e-2c2efac597d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962c3e24-c462-4f14-8359-2de4f80b004b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962c3e24-c462-4f14-8359-2de4f80b004b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1488029601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa73ad54-704e-4202-b5fd-ef9ea2b2da00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b16fb3609af461499f96e7683a0b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:36Z,use_quota=True,user_id='7f27f2096247433da51d5dc5011e4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08a2617-752e-4b60-ac09-04adfabc296d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f08a2617-752e-4b60-ac09-04adfabc296d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae59109-c434-4adc-a397-ab4cb49c4389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae59109-c434-4adc-a397-ab4cb49c4389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa73ad54-704e-4202-b5fd-ef9ea2b2da00', 'volume_name': 'volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8320a5ff-4597-478c-b774-3bdc86197456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8320a5ff-4597-478c-b774-3bdc86197456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538d8e8b-feae-4778-9524-7b5cf7f7dfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:36 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Volume fa73ad54-704e-4202-b5fd-ef9ea2b2da00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00', 'volume_size': 1}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40451e7-123f-476d-a26b-374558964d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77713a19-2367-4b16-9207-917eab6fe6bf', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65124c4-ba6d-4e11-910e-9c4a3fde3efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:36 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Volume volume-77713a19-2367-4b16-9207-917eab6fe6bf (77713a19-2367-4b16-9207-917eab6fe6bf): created successfully
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65124c4-ba6d-4e11-910e-9c4a3fde3efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Flow 'volume_create_manager' (dfd3aa1f-1920-465b-9b7f-4fb92c0bf1d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:36 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c90633db-eba4-4473-8a76-e15d7a3ed055 tempest-CreateVolumesFromImageTest-1308452742 None] Created volume successfully.
Jul 03 23:55:37 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08" returned: 0 in 0.944s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:37 devstack sudo[95071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08
Jul 03 23:55:37 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:37 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d 1073741824" returned: 0 in 1.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:37 devstack sudo[95073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d
Jul 03 23:55:37 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:38 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f.f87e6fe6-a2ef-4b2a-95de-81088e0c4c08" returned: 0 in 0.680s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-f87e6fe6-a2ef-4b2a-95de-81088e0c4c08" released by "_delete_snapshot" :: held 4.687s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-a88b6a25-ef71-47ad-8ded-799914f1443f" released by "delete_snapshot" :: held 4.734s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:38 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d" returned: 0 in 0.645s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.958s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744181863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2266f838-c40d-45a7-b78a-05509b25fb66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b16fb3609af461499f96e7683a0b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:35Z,use_quota=True,user_id='7f27f2096247433da51d5dc5011e4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Creating volume 2266f838-c40d-45a7-b78a-05509b25fb66 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:38 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2266f838-c40d-45a7-b78a-05509b25fb66 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:38 devstack sudo[95077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2266f838-c40d-45a7-b78a-05509b25fb66 1073741824
Jul 03 23:55:38 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fbba17-7aa5-4fc9-b5e7-fe7fbfc3ecdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032477eb-2025-414c-871c-2f4d052afdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:38 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Volume volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d (6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d): created successfully
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032477eb-2025-414c-871c-2f4d052afdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Flow 'volume_create_manager' (c747beab-e7c2-4c41-bf76-4d188191bc29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f8c49f4f-1b1a-4c28-9c09-dca67e2301b3 tempest-CreateVolumesFromImageTest-1308452742 None] Created volume successfully.
Jul 03 23:55:38 devstack cinder-volume[86648]: WARNING cinder.quota [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1888520954 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1888520954, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:55:38 devstack cinder-volume[86648]: WARNING cinder.quota [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1888520954 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1888520954, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['58e07d59-a849-4e58-92d4-d637354ac21a', '38f4c68a-04a7-4dae-af53-cedd6d441898', '9e5194ce-49a7-46a7-8f3c-cb04c164cd18', 'cd86d2d1-4e44-4e96-b500-fe187f94be67'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-06282717-8a30-4e96-b4ff-1818007b00ed tempest-GroupSnapshotsTest-1139627404 None] group_snapshot 53b9e003-b6b4-46d8-9b4a-a205ac033ebf: deleted successfully
Jul 03 23:55:38 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2266f838-c40d-45a7-b78a-05509b25fb66 1073741824" returned: 0 in 0.820s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2266f838-c40d-45a7-b78a-05509b25fb66 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:38 devstack sudo[95082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2266f838-c40d-45a7-b78a-05509b25fb66
Jul 03 23:55:38 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "cinder-quobyte-a88b6a25-ef71-47ad-8ded-799914f1443f" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-a88b6a25-ef71-47ad-8ded-799914f1443f" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb67121f-29f8-4fd6-ba0e-1c0b7f43275e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:39 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2266f838-c40d-45a7-b78a-05509b25fb66" returned: 0 in 0.679s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.893s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1409886329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1e0e44-7b42-4070-8055-53b4b95be98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b16fb3609af461499f96e7683a0b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:35Z,use_quota=True,user_id='7f27f2096247433da51d5dc5011e4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Creating volume cf1e0e44-7b42-4070-8055-53b4b95be98a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:39 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf1e0e44-7b42-4070-8055-53b4b95be98a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:39 devstack sudo[95086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf1e0e44-7b42-4070-8055-53b4b95be98a 1073741824
Jul 03 23:55:39 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10f6992-7305-486b-8a2c-29739c4347c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2266f838-c40d-45a7-b78a-05509b25fb66', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afc63c4-6dd0-41b2-8356-fadbb6fc84ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:39 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Volume volume-2266f838-c40d-45a7-b78a-05509b25fb66 (2266f838-c40d-45a7-b78a-05509b25fb66): created successfully
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1afc63c4-6dd0-41b2-8356-fadbb6fc84ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Flow 'volume_create_manager' (4beb1e6a-cc14-42a2-8920-9c3abdc4b76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-48f78da0-09e6-4c58-98ca-f17465a823cb tempest-CreateVolumesFromImageTest-1308452742 None] Created volume successfully.
Jul 03 23:55:39 devstack sudo[95085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f
Jul 03 23:55:39 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:40 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f" returned: 0 in 0.838s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:40 devstack sudo[95096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f
Jul 03 23:55:40 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:40 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf1e0e44-7b42-4070-8055-53b4b95be98a 1073741824" returned: 0 in 1.110s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf1e0e44-7b42-4070-8055-53b4b95be98a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:40 devstack sudo[95099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf1e0e44-7b42-4070-8055-53b4b95be98a
Jul 03 23:55:40 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:41 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a88b6a25-ef71-47ad-8ded-799914f1443f" returned: 0 in 0.873s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Lock "cinder-quobyte-a88b6a25-ef71-47ad-8ded-799914f1443f" released by "delete_volume" :: held 1.819s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['88e54322-e758-4a92-9027-47dd9ecfca04'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:41 devstack cinder-volume[86648]: WARNING cinder.quota [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1888520954 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1888520954, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Created reservations ['3c420ec4-d308-41c5-9927-ab06168e4fe3', 'f14af77f-0bc6-49ff-97c7-299d5bea8f6a', '598a1291-2c53-4b14-88e4-07e3776481f1', '4519e2d6-f603-4d27-a02d-36b7d5a77245'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:41 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf1e0e44-7b42-4070-8055-53b4b95be98a" returned: 0 in 0.883s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.226s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1589626501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=399de603-6810-4812-90c8-27b0d574037b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c4b924b8fdc429f83433ce074ea1412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:36Z,use_quota=True,user_id='3c9d81bba98747129d985a56897911dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Creating volume 399de603-6810-4812-90c8-27b0d574037b {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:41 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:55:41 devstack sudo[95103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:41 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-399de603-6810-4812-90c8-27b0d574037b 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d88035-8296-48a1-a96a-17618b6a1c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf1e0e44-7b42-4070-8055-53b4b95be98a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b8b853-304a-4a0e-b4e7-6a4f6936b831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:41 devstack sudo[95105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-399de603-6810-4812-90c8-27b0d574037b 1073741824
Jul 03 23:55:41 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:41 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Volume volume-cf1e0e44-7b42-4070-8055-53b4b95be98a (cf1e0e44-7b42-4070-8055-53b4b95be98a): created successfully
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b8b853-304a-4a0e-b4e7-6a4f6936b831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Flow 'volume_create_manager' (24b0e002-05a6-4a8f-a373-cd413388f076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:41 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2dfb2a89-6228-45cd-8c59-f728443b9a3d tempest-CreateVolumesFromImageTest-1308452742 None] Created volume successfully.
Jul 03 23:55:42 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.940s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:42 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5a82fe83-cb36-46f0-887e-736fe0142ce0 tempest-GroupSnapshotsTest-1139627404 None] Delete group completed successfully.
Jul 03 23:55:42 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-399de603-6810-4812-90c8-27b0d574037b 1073741824" returned: 0 in 1.148s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-399de603-6810-4812-90c8-27b0d574037b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:42 devstack sudo[95113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-399de603-6810-4812-90c8-27b0d574037b
Jul 03 23:55:42 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:43 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-399de603-6810-4812-90c8-27b0d574037b" returned: 0 in 0.768s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] <== create_volume: return (1967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.970s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.093s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1488029601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa73ad54-704e-4202-b5fd-ef9ea2b2da00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b16fb3609af461499f96e7683a0b333',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:36Z,use_quota=True,user_id='7f27f2096247433da51d5dc5011e4859',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Creating volume fa73ad54-704e-4202-b5fd-ef9ea2b2da00 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:43 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adb70822-3ffb-42b0-8f88-b5dff07550bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-399de603-6810-4812-90c8-27b0d574037b', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:43 devstack sudo[95116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00 1073741824
Jul 03 23:55:43 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58241c83-55e8-4415-8fb3-50382162a19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:43 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Volume volume-399de603-6810-4812-90c8-27b0d574037b (399de603-6810-4812-90c8-27b0d574037b): created successfully
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58241c83-55e8-4415-8fb3-50382162a19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Flow 'volume_create_manager' (8191a137-6c85-452a-a3a5-afeec337ecec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:43 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6ea89a0b-0e2f-4e3f-818e-88921afbf7b5 tempest-VolumesTestJSON-1078164351 None] Created volume successfully.
Jul 03 23:55:44 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00 1073741824" returned: 0 in 1.145s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:44 devstack sudo[95122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00
Jul 03 23:55:44 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Flow 'volume_create_manager' (63a98330-513f-48f2-9c22-1f8bdebc8453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61113ac4-52f4-4dee-aa42-0f6a3e1b4675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61113ac4-52f4-4dee-aa42-0f6a3e1b4675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1920490420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59287b10-72b5-459e-85ca-454a464d451a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c4b924b8fdc429f83433ce074ea1412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:45Z,use_quota=True,user_id='3c9d81bba98747129d985a56897911dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64bd3ac7-5e62-4a65-8fd4-1e47a8889174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64bd3ac7-5e62-4a65-8fd4-1e47a8889174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42604aeb-e825-4f7d-9f78-febf38a5f287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42604aeb-e825-4f7d-9f78-febf38a5f287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59287b10-72b5-459e-85ca-454a464d451a', 'volume_name': 'volume-59287b10-72b5-459e-85ca-454a464d451a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3825af55-eaff-40de-9533-2428376370f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3825af55-eaff-40de-9533-2428376370f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5171b60-2e84-46ab-9569-20feb876c80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:45 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Volume 59287b10-72b5-459e-85ca-454a464d451a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59287b10-72b5-459e-85ca-454a464d451a', 'volume_size': 1}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:45 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00" returned: 0 in 0.951s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1920490420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59287b10-72b5-459e-85ca-454a464d451a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c4b924b8fdc429f83433ce074ea1412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:45Z,use_quota=True,user_id='3c9d81bba98747129d985a56897911dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Creating volume 59287b10-72b5-459e-85ca-454a464d451a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:45 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-59287b10-72b5-459e-85ca-454a464d451a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:45 devstack sudo[95125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-59287b10-72b5-459e-85ca-454a464d451a 1073741824
Jul 03 23:55:45 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538d8e8b-feae-4778-9524-7b5cf7f7dfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf99f7bd-2d67-4942-af1d-a2c933f32212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:45 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Volume volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00 (fa73ad54-704e-4202-b5fd-ef9ea2b2da00): created successfully
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf99f7bd-2d67-4942-af1d-a2c933f32212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Flow 'volume_create_manager' (824421bd-3c34-4198-a71e-2c2efac597d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:45 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1048c774-3b39-4219-bb16-5a94697dfdc4 tempest-CreateVolumesFromImageTest-1308452742 None] Created volume successfully.
Jul 03 23:55:46 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-59287b10-72b5-459e-85ca-454a464d451a 1073741824" returned: 0 in 1.098s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "cinder-fa73ad54-704e-4202-b5fd-ef9ea2b2da00-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-fa73ad54-704e-4202-b5fd-ef9ea2b2da00-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-59287b10-72b5-459e-85ca-454a464d451a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:47 devstack sudo[95133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-59287b10-72b5-459e-85ca-454a464d451a
Jul 03 23:55:47 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "cinder-quobyte-fa73ad54-704e-4202-b5fd-ef9ea2b2da00" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-quobyte-fa73ad54-704e-4202-b5fd-ef9ea2b2da00" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e28cf40-00ae-457d-9893-b64424059f7d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:47 devstack sudo[95135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00
Jul 03 23:55:47 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:47 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-59287b10-72b5-459e-85ca-454a464d451a" returned: 0 in 0.840s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5171b60-2e84-46ab-9569-20feb876c80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59287b10-72b5-459e-85ca-454a464d451a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f88bda8-a56b-4052-aadb-86ca5b003389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:47 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Volume volume-59287b10-72b5-459e-85ca-454a464d451a (59287b10-72b5-459e-85ca-454a464d451a): created successfully
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f88bda8-a56b-4052-aadb-86ca5b003389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Flow 'volume_create_manager' (63a98330-513f-48f2-9c22-1f8bdebc8453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:47 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ac060352-53e6-439c-9a3f-8f703b10c6d4 tempest-VolumesTestJSON-1078164351 None] Created volume successfully.
Jul 03 23:55:48 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00" returned: 0 in 0.988s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:48 devstack sudo[95141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00
Jul 03 23:55:48 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9499c6f0-f41b-4440-bfe3-e7f8d0005db3 tempest-GroupsV320Test-524973767 None] Group tempest-GroupsV320Test-Group-742072162: creating
Jul 03 23:55:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9499c6f0-f41b-4440-bfe3-e7f8d0005db3 tempest-GroupsV320Test-524973767 None] Group tempest-GroupsV320Test-Group-742072162: created successfully
Jul 03 23:55:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9499c6f0-f41b-4440-bfe3-e7f8d0005db3 tempest-GroupsV320Test-524973767 None] Create group completed successfully.
Jul 03 23:55:48 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fa73ad54-704e-4202-b5fd-ef9ea2b2da00" returned: 0 in 0.781s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-quobyte-fa73ad54-704e-4202-b5fd-ef9ea2b2da00" released by "delete_volume" :: held 1.839s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Created reservations ['546d54d6-140d-4b69-87ff-94cc09fb0417', '93ff58ff-6b5b-4ed2-84ae-72454455471c', '381dc643-8f66-4225-bbcb-7996267e7435', 'c318cc1a-3ea0-4266-a587-a8f743ade2e1'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:49 devstack sudo[95144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:49 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "cinder-cf1e0e44-7b42-4070-8055-53b4b95be98a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Flow 'volume_create_manager' (1c3e12a8-5e7e-4518-84f7-4c9a4366da03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7944b2c7-5177-46f8-b63b-d3a5f76910e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-cf1e0e44-7b42-4070-8055-53b4b95be98a-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7944b2c7-5177-46f8-b63b-d3a5f76910e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1758014775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bede79-bcf7-46d1-a213-de3d919bf580,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c4b924b8fdc429f83433ce074ea1412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:49Z,use_quota=True,user_id='3c9d81bba98747129d985a56897911dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2badf653-de3d-4d13-9b65-b3602169151e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2badf653-de3d-4d13-9b65-b3602169151e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b73b5d-8217-46a0-ba61-9561fce8e7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b73b5d-8217-46a0-ba61-9561fce8e7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40bede79-bcf7-46d1-a213-de3d919bf580', 'volume_name': 'volume-40bede79-bcf7-46d1-a213-de3d919bf580', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e40297-d118-401e-9880-d17fd939f734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6e40297-d118-401e-9880-d17fd939f734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927fb857-0eee-4afc-a7ec-60c44b557f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:49 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Volume 40bede79-bcf7-46d1-a213-de3d919bf580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40bede79-bcf7-46d1-a213-de3d919bf580', 'volume_size': 1}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1758014775',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40bede79-bcf7-46d1-a213-de3d919bf580,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c4b924b8fdc429f83433ce074ea1412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:49Z,use_quota=True,user_id='3c9d81bba98747129d985a56897911dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Creating volume 40bede79-bcf7-46d1-a213-de3d919bf580 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:49 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40bede79-bcf7-46d1-a213-de3d919bf580 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:49 devstack sudo[95146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40bede79-bcf7-46d1-a213-de3d919bf580 1073741824
Jul 03 23:55:49 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "cinder-quobyte-cf1e0e44-7b42-4070-8055-53b4b95be98a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-quobyte-cf1e0e44-7b42-4070-8055-53b4b95be98a" acquired by "delete_volume" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc60d52-bc4a-495e-b0ba-2b363084b554]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf1e0e44-7b42-4070-8055-53b4b95be98a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:49 devstack sudo[95148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf1e0e44-7b42-4070-8055-53b4b95be98a
Jul 03 23:55:49 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:49 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.873s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:49 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:50 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Deleted volume successfully.
Jul 03 23:55:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-054cdb43-1921-400a-8245-2211053cfcf9 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-fa73ad54-704e-4202-b5fd-ef9ea2b2da00-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:50 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-6ab2fcd8-0eea-4d4c-9168-ae7f1cd22ed7 tempest-GroupsV320Test-524973767 None] Created reservations ['65a42a1f-a491-4a09-b75e-591d960e9f3f'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:50 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf1e0e44-7b42-4070-8055-53b4b95be98a" returned: 0 in 1.183s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf1e0e44-7b42-4070-8055-53b4b95be98a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:50 devstack sudo[95158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf1e0e44-7b42-4070-8055-53b4b95be98a
Jul 03 23:55:50 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6ab2fcd8-0eea-4d4c-9168-ae7f1cd22ed7 tempest-GroupsV320Test-524973767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6ab2fcd8-0eea-4d4c-9168-ae7f1cd22ed7 tempest-GroupsV320Test-524973767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2fcd8-0eea-4d4c-9168-ae7f1cd22ed7 tempest-GroupsV320Test-524973767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6ab2fcd8-0eea-4d4c-9168-ae7f1cd22ed7 tempest-GroupsV320Test-524973767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6ab2fcd8-0eea-4d4c-9168-ae7f1cd22ed7 tempest-GroupsV320Test-524973767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ab2fcd8-0eea-4d4c-9168-ae7f1cd22ed7 tempest-GroupsV320Test-524973767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:50 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40bede79-bcf7-46d1-a213-de3d919bf580 1073741824" returned: 0 in 1.386s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:50 devstack sudo[95160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:50 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40bede79-bcf7-46d1-a213-de3d919bf580 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:50 devstack sudo[95162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40bede79-bcf7-46d1-a213-de3d919bf580
Jul 03 23:55:50 devstack sudo[95162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:51 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf1e0e44-7b42-4070-8055-53b4b95be98a" returned: 0 in 0.832s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:51 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6ab2fcd8-0eea-4d4c-9168-ae7f1cd22ed7 tempest-GroupsV320Test-524973767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.797s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-6ab2fcd8-0eea-4d4c-9168-ae7f1cd22ed7 tempest-GroupsV320Test-524973767 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-quobyte-cf1e0e44-7b42-4070-8055-53b4b95be98a" released by "delete_volume" :: held 2.106s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:51 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6ab2fcd8-0eea-4d4c-9168-ae7f1cd22ed7 tempest-GroupsV320Test-524973767 None] Delete group completed successfully.
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Created reservations ['2749bb50-7f27-4c81-8f4e-ab19f75a0cab', '621a3434-bdb9-46e7-b665-8541344a8fe4', 'f378829c-b6eb-4c84-996d-af5f817d0400', '33eecf97-8a83-4550-b7ac-28a6aa4d31e1'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:51 devstack sudo[95162]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40bede79-bcf7-46d1-a213-de3d919bf580" returned: 0 in 0.834s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.280s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (927fb857-0eee-4afc-a7ec-60c44b557f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40bede79-bcf7-46d1-a213-de3d919bf580', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e5bec2-1410-4ef4-8834-a525c063427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:51 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Volume volume-40bede79-bcf7-46d1-a213-de3d919bf580 (40bede79-bcf7-46d1-a213-de3d919bf580): created successfully
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1e5bec2-1410-4ef4-8834-a525c063427f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Flow 'volume_create_manager' (1c3e12a8-5e7e-4518-84f7-4c9a4366da03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:51 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a5e49bf0-16fb-47a5-b577-3ea2756df41a tempest-VolumesTestJSON-1078164351 None] Created volume successfully.
Jul 03 23:55:51 devstack sudo[95167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:51 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:52 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.823s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:52 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:52 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Deleted volume successfully.
Jul 03 23:55:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b95aaa36-7ce8-4600-b613-bd63289c3fe2 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-cf1e0e44-7b42-4070-8055-53b4b95be98a-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "cinder-2266f838-c40d-45a7-b78a-05509b25fb66-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-2266f838-c40d-45a7-b78a-05509b25fb66-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "cinder-quobyte-2266f838-c40d-45a7-b78a-05509b25fb66" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-quobyte-2266f838-c40d-45a7-b78a-05509b25fb66" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:52 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f238aa-95d5-450e-9cb4-39f31ad2ac2d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2266f838-c40d-45a7-b78a-05509b25fb66 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:53 devstack sudo[95170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2266f838-c40d-45a7-b78a-05509b25fb66
Jul 03 23:55:53 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Acquiring lock "cinder-40bede79-bcf7-46d1-a213-de3d919bf580-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Lock "cinder-40bede79-bcf7-46d1-a213-de3d919bf580-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:53 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2266f838-c40d-45a7-b78a-05509b25fb66" returned: 0 in 0.959s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2266f838-c40d-45a7-b78a-05509b25fb66 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:53 devstack sudo[95176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2266f838-c40d-45a7-b78a-05509b25fb66
Jul 03 23:55:53 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Acquiring lock "cinder-quobyte-40bede79-bcf7-46d1-a213-de3d919bf580" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Lock "cinder-quobyte-40bede79-bcf7-46d1-a213-de3d919bf580" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:53 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2a1c4d-c5fc-42a9-9949-9b7b08f555d7]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40bede79-bcf7-46d1-a213-de3d919bf580 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:54 devstack sudo[95178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40bede79-bcf7-46d1-a213-de3d919bf580
Jul 03 23:55:54 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:54 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2266f838-c40d-45a7-b78a-05509b25fb66" returned: 0 in 0.915s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-quobyte-2266f838-c40d-45a7-b78a-05509b25fb66" released by "delete_volume" :: held 1.942s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:54 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Created reservations ['c9212463-ecb0-4dad-b836-8c002596df82', 'f7372f40-1a64-4e1a-8b31-d2ec9ffee742', '6c7d8786-2b29-4313-b1eb-8b7ab81dc3dc', '72f3c02c-980a-49df-ae8f-0bade2800ec8'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:55 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40bede79-bcf7-46d1-a213-de3d919bf580" returned: 0 in 1.087s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40bede79-bcf7-46d1-a213-de3d919bf580 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:55 devstack sudo[95184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:55 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:55 devstack sudo[95186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40bede79-bcf7-46d1-a213-de3d919bf580
Jul 03 23:55:55 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "cinder-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "cinder-quobyte-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-quobyte-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2203d1e4-dc96-4d2c-bf68-8b7b34cd5496]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:55 devstack sudo[95188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d
Jul 03 23:55:55 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:56 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.212s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:56 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Deleted volume successfully.
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-41d740e7-6729-4f9d-a345-bd547d93d5e9 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-2266f838-c40d-45a7-b78a-05509b25fb66-delete_volume" released by "delete_volume" :: held 3.545s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:56 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40bede79-bcf7-46d1-a213-de3d919bf580" returned: 0 in 1.288s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Lock "cinder-quobyte-40bede79-bcf7-46d1-a213-de3d919bf580" released by "delete_volume" :: held 2.455s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Created reservations ['d0aea7b1-90df-441c-8f8d-a5e1e77b4604', '78becfa0-7bdd-4f24-86d2-cf36d42fa4fa', 'bd758a39-0692-4e11-ad0f-15dde0c412dd', 'eddf5a1a-b426-4873-8619-d6b924ff4d18'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:56 devstack sudo[95195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:56 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:56 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d" returned: 0 in 1.467s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:56 devstack sudo[95197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d
Jul 03 23:55:56 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Acquiring lock "cinder-59287b10-72b5-459e-85ca-454a464d451a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Lock "cinder-59287b10-72b5-459e-85ca-454a464d451a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Acquiring lock "cinder-quobyte-59287b10-72b5-459e-85ca-454a464d451a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Lock "cinder-quobyte-59287b10-72b5-459e-85ca-454a464d451a" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:57 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a364c383-0117-490a-aece-fe1bcaeb4440]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-59287b10-72b5-459e-85ca-454a464d451a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:57 devstack sudo[95199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-59287b10-72b5-459e-85ca-454a464d451a
Jul 03 23:55:57 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:57 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.123s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:57 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:57 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Deleted volume successfully.
Jul 03 23:55:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fabca911-f610-414d-9bf0-5dca183d43ea tempest-VolumesTestJSON-1078164351 None] Lock "cinder-40bede79-bcf7-46d1-a213-de3d919bf580-delete_volume" released by "delete_volume" :: held 4.055s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:58 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d" returned: 0 in 1.413s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-quobyte-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d" released by "delete_volume" :: held 2.944s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Created reservations ['3df83c96-f8b9-4b9d-9a29-ff4027c93ea8', '41dcd062-006a-49b9-ad9e-3a2b4e5ef06b', '6c99d48c-1164-4ae8-ac3e-738727543d1f', 'd58dd1ab-16cb-4da3-adb8-fd5750605dae'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:58 devstack sudo[95205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:55:58 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:58 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-59287b10-72b5-459e-85ca-454a464d451a" returned: 0 in 1.364s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-59287b10-72b5-459e-85ca-454a464d451a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "cinder-77713a19-2367-4b16-9207-917eab6fe6bf-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:58 devstack sudo[95208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-59287b10-72b5-459e-85ca-454a464d451a
Jul 03 23:55:58 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-77713a19-2367-4b16-9207-917eab6fe6bf-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "cinder-quobyte-77713a19-2367-4b16-9207-917eab6fe6bf" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-quobyte-77713a19-2367-4b16-9207-917eab6fe6bf" acquired by "delete_volume" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f7fc17-1f26-4631-9ad3-fceb1d5f21e5]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-77713a19-2367-4b16-9207-917eab6fe6bf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:59 devstack sudo[95210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-77713a19-2367-4b16-9207-917eab6fe6bf
Jul 03 23:55:59 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:59 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.906s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:59 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:59 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Deleted volume successfully.
Jul 03 23:55:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a513820e-3e59-41be-b1e0-b3fec2a1a3d1 tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-6c5fb0c6-c5ef-40c0-a217-316a64dc4f9d-delete_volume" released by "delete_volume" :: held 4.186s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:59 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-59287b10-72b5-459e-85ca-454a464d451a" returned: 0 in 1.127s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Lock "cinder-quobyte-59287b10-72b5-459e-85ca-454a464d451a" released by "delete_volume" :: held 2.582s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Created reservations ['894e6eca-b827-4363-ad9e-b13cbb03b305', 'b40cf2d0-5134-4a1f-8942-b903dc1d023d', '406aa206-2edb-4d97-b974-d2b0f54e1c72', '5cad9cdf-48af-47cb-abeb-67cd92c42d72'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:00 devstack sudo[95220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:56:00 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Flow 'volume_create_manager' (29cab56b-9dc4-419e-9f9f-6683567383e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b7b15e-08df-465b-8198-18ad9ccfaf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:00 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b7b15e-08df-465b-8198-18ad9ccfaf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2098778728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96813a0-4b98-4821-8d07-6c8c07c47343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114311a4a3a3419bbcb559a254527d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:00Z,use_quota=True,user_id='5e6ce8930bfa4a86879c3daf363df1e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca61fe9-4629-4246-bfe6-add4ecaca8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca61fe9-4629-4246-bfe6-add4ecaca8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac86fe58-7c37-451d-8bb6-21e108087e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac86fe58-7c37-451d-8bb6-21e108087e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a96813a0-4b98-4821-8d07-6c8c07c47343', 'volume_name': 'volume-a96813a0-4b98-4821-8d07-6c8c07c47343', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfb80cf-412c-424d-8493-a195774bee39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cfb80cf-412c-424d-8493-a195774bee39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c6ad7b-c72d-445e-85b6-3f20d92f231f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:00 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Volume a96813a0-4b98-4821-8d07-6c8c07c47343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a96813a0-4b98-4821-8d07-6c8c07c47343', 'volume_size': 1}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2098778728',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96813a0-4b98-4821-8d07-6c8c07c47343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='114311a4a3a3419bbcb559a254527d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:00Z,use_quota=True,user_id='5e6ce8930bfa4a86879c3daf363df1e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Creating volume a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:00 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-77713a19-2367-4b16-9207-917eab6fe6bf" returned: 0 in 1.621s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-77713a19-2367-4b16-9207-917eab6fe6bf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:00 devstack sudo[95222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343 1073741824
Jul 03 23:56:00 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:00 devstack sudo[95223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-77713a19-2367-4b16-9207-917eab6fe6bf
Jul 03 23:56:00 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Acquiring lock "cinder-399de603-6810-4812-90c8-27b0d574037b-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Lock "cinder-399de603-6810-4812-90c8-27b0d574037b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Acquiring lock "cinder-quobyte-399de603-6810-4812-90c8-27b0d574037b" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Lock "cinder-quobyte-399de603-6810-4812-90c8-27b0d574037b" acquired by "delete_volume" :: waited 0.047s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:01 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60bc17b-a189-408b-9358-2f5104c97068]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-399de603-6810-4812-90c8-27b0d574037b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:01 devstack sudo[95226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-399de603-6810-4812-90c8-27b0d574037b
Jul 03 23:56:01 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:01 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.306s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:01 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:01 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Deleted volume successfully.
Jul 03 23:56:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cd0282c7-560b-4a86-8ad0-8919ce1486d7 tempest-VolumesTestJSON-1078164351 None] Lock "cinder-59287b10-72b5-459e-85ca-454a464d451a-delete_volume" released by "delete_volume" :: held 4.368s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:01 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343 1073741824" returned: 0 in 1.257s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:01 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-77713a19-2367-4b16-9207-917eab6fe6bf" returned: 0 in 1.282s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:01 devstack sudo[95234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343
Jul 03 23:56:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-quobyte-77713a19-2367-4b16-9207-917eab6fe6bf" released by "delete_volume" :: held 2.975s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:01 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:01 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Created reservations ['5ad671f5-39cf-4e60-942e-712574108730', 'af93041f-77ea-4d42-ba2e-4347a40a257e', 'd6383370-563e-4cf8-b26c-49973e883cdb', 'a40006f1-b971-4896-9b5d-b690d71ffb6b'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:02 devstack sudo[95236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:56:02 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:02 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-399de603-6810-4812-90c8-27b0d574037b" returned: 0 in 1.431s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-399de603-6810-4812-90c8-27b0d574037b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:02 devstack sudo[95242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-399de603-6810-4812-90c8-27b0d574037b
Jul 03 23:56:02 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:02 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343" returned: 0 in 0.855s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c6ad7b-c72d-445e-85b6-3f20d92f231f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a96813a0-4b98-4821-8d07-6c8c07c47343', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c93fc3-cd0f-4769-9104-0d876c2390bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:02 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Volume volume-a96813a0-4b98-4821-8d07-6c8c07c47343 (a96813a0-4b98-4821-8d07-6c8c07c47343): created successfully
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c93fc3-cd0f-4769-9104-0d876c2390bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Flow 'volume_create_manager' (29cab56b-9dc4-419e-9f9f-6683567383e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:02 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b833ba7d-19b4-4089-bdab-84aed4dfbb96 tempest-SnapshotsActionsTest-1976681278 None] Created volume successfully.
Jul 03 23:56:03 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.100s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:03 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:03 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Deleted volume successfully.
Jul 03 23:56:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-25e5d662-4767-4dfa-bedb-3b37cad12e3c tempest-CreateVolumesFromImageTest-1308452742 None] Lock "cinder-77713a19-2367-4b16-9207-917eab6fe6bf-delete_volume" released by "delete_volume" :: held 4.459s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:03 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-399de603-6810-4812-90c8-27b0d574037b" returned: 0 in 0.822s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Lock "cinder-quobyte-399de603-6810-4812-90c8-27b0d574037b" released by "delete_volume" :: held 2.361s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:03 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Created reservations ['d42e00d9-46cc-4c45-8140-1201b3379496', 'c911ba3f-7d1f-42b6-b395-9f2d3f68cda3', '0eea4fa4-0c59-4ecb-bf66-0bb011681565', '6d472d4e-bcf3-41cb-a7a4-fae894fe52bc'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:03 devstack sudo[95247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:56:03 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:04 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] Creating offline snapshot e1e26ec0-ab29-4297-8b28-cde6c530cc87 of volume a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:56:04 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6d37c7-1a04-4f49-9fc1-de81b0a5f58e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:04 devstack sudo[95249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343
Jul 03 23:56:04 devstack sudo[95249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:04 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.197s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:04 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:04 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Deleted volume successfully.
Jul 03 23:56:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7b8c9c0d-d769-4eb2-b1f9-0bb1e355dfe0 tempest-VolumesTestJSON-1078164351 None] Lock "cinder-399de603-6810-4812-90c8-27b0d574037b-delete_volume" released by "delete_volume" :: held 3.940s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:56:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:05 devstack sudo[95249]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343" returned: 0 in 1.083s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:05 devstack sudo[95255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:56:05 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:05 devstack sudo[95256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 1G
Jul 03 23:56:05 devstack sudo[95256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:05 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.862s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:06 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:56:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 8 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:56:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:56:06 devstack sudo[95256]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 1G" returned: 0 in 1.301s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:06 devstack sudo[95267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:06 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:07 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 0.982s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:07 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 is being set with open permissions: ugo+rw
Jul 03 23:56:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:07 devstack sudo[95306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:07 devstack sudo[95306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:08 devstack sudo[95306]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 0.928s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:08 devstack sudo[95314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.info
Jul 03 23:56:08 devstack sudo[95314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:09 devstack sudo[95314]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.info" returned: 0 in 0.778s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:09 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.info is being set with open permissions: ugo+rw
Jul 03 23:56:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:09 devstack sudo[95317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.info
Jul 03 23:56:09 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-49bba58e-f734-40e1-92aa-08fecd81bf62 tempest-GroupSnapshotsV319Test-1004070803 None] Group tempest-GroupSnapshotsV319Test-Group-1042034517: creating
Jul 03 23:56:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-49bba58e-f734-40e1-92aa-08fecd81bf62 tempest-GroupSnapshotsV319Test-1004070803 None] Group tempest-GroupSnapshotsV319Test-Group-1042034517: created successfully
Jul 03 23:56:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-49bba58e-f734-40e1-92aa-08fecd81bf62 tempest-GroupSnapshotsV319Test-1004070803 None] Create group completed successfully.
Jul 03 23:56:09 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.info" returned: 0 in 0.752s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.984s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:10 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-05496153-a6ae-45e3-ba28-b9736278184a tempest-SnapshotsActionsTest-1976681278 None] Create snapshot completed successfully
Jul 03 23:56:10 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Flow 'volume_create_manager' (ff0c2178-c101-450f-af3d-d4bccae405ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0b3890-01ce-4ae7-9cb0-df31b27dd111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0b3890-01ce-4ae7-9cb0-df31b27dd111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406999cc-af03-4a91-bb9b-33a4cb69f2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fad4067fc3476d860656119de9e61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:11Z,use_quota=True,user_id='79891c3a16e14cd9bbe28b4230b1c9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ceb7a9-dfd0-4e51-a415-5c8f797e824c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ceb7a9-dfd0-4e51-a415-5c8f797e824c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c7c5ae-b7c4-473f-ab1f-badd53d298ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:10 devstack cinder-volume[86648]: DEBUG cinder.image.glance [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Creating Keystone auth plugin from conf {{(pid=86648) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 23:56:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] Creating offline snapshot 68606957-98de-4095-8d91-5d1154dca17a of volume a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a540fda-9b75-42b3-8edb-acb7fdb71561]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:11 devstack sudo[95321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:11 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c7c5ae-b7c4-473f-ab1f-badd53d298ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '406999cc-af03-4a91-bb9b-33a4cb69f2a2', 'volume_name': 'volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2', 'volume_size': 1, 'image_id': '90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9745d8118c6516971762b86d34095c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3fad4067fc3476d860656119de9e61f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '191ed8cb20f4a3aaa79627ba8752e2a7af542b7d25ab5eb20ced33e8546136c80385ede8fa9983c2922ed79fbf871fd98cfb5ff2f9b09a6f16d2ba3f602313a0', 'id': '90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'created_at': datetime.datetime(2026, 7, 3, 21, 56, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 56, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ce4227-e30d-4e8f-899d-a2d5cb37437c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c711b20>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a311ee9-bcab-4593-8739-2565bbdc3b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a311ee9-bcab-4593-8739-2565bbdc3b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a837e6f-6941-49f0-abeb-b29b378cb996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:11 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Volume 406999cc-af03-4a91-bb9b-33a4cb69f2a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2', 'volume_size': 1, 'image_id': '90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9745d8118c6516971762b86d34095c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3fad4067fc3476d860656119de9e61f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '191ed8cb20f4a3aaa79627ba8752e2a7af542b7d25ab5eb20ced33e8546136c80385ede8fa9983c2922ed79fbf871fd98cfb5ff2f9b09a6f16d2ba3f602313a0', 'id': '90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'created_at': datetime.datetime(2026, 7, 3, 21, 56, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 56, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ce4227-e30d-4e8f-899d-a2d5cb37437c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c711b20>}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Trying to clone 406999cc-af03-4a91-bb9b-33a4cb69f2a2 from image 90ce4227-e30d-4e8f-899d-a2d5cb37437c at location (None, [{'url': 'file:///opt/stack/data/glance/images/90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'metadata': {}}]). {{(pid=86648) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 23:56:11 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Image download 0.00 MB at 0.00 MB/s
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Flow 'volume_create_manager' (f9aa2d41-0c4e-462e-a3fe-f2bf79f413cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fdb8cb-0b06-41dd-9bde-fca535458445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25fdb8cb-0b06-41dd-9bde-fca535458445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1477180205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e8713f1-deed-46b7-ac9e-7278a8624aea,host='devstack@QuobyteHD#QuobyteHD',id=e9d18a4c-4e58-4694-87ee-d327ad077e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1eab7b26d1643129637efde1acea67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:12Z,use_quota=True,user_id='d82a2c3f5988443886ba2b00657f919a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28b3ba7d-6ae8-47bd-8f21-5f92df866a5f),volume_type_id=28b3ba7d-6ae8-47bd-8f21-5f92df866a5f)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e495f51f-e31f-4bf7-a159-76afdf07c604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e495f51f-e31f-4bf7-a159-76afdf07c604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1702b4af-a3b0-4d95-a96c-c45ed374d5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1702b4af-a3b0-4d95-a96c-c45ed374d5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d18a4c-4e58-4694-87ee-d327ad077e0a', 'volume_name': 'volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f368de44-6560-4f9c-86d5-672c19b69c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f368de44-6560-4f9c-86d5-672c19b69c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af66265a-b41f-4b2b-a88e-1fb686956905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:11 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Volume e9d18a4c-4e58-4694-87ee-d327ad077e0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a', 'volume_size': 1}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a4287c-1c49-4c76-bf74-48e7cd6772a5]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:11 devstack sudo[95343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD
Jul 03 23:56:11 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:12 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 0.996s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:12 devstack sudo[95348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a 1G
Jul 03 23:56:12 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:12 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD" returned: 0 in 0.745s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:12 devstack sudo[95352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD
Jul 03 23:56:12 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:12 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a 1G" returned: 0 in 0.913s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:13 devstack sudo[95358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a
Jul 03 23:56:13 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:13 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD" returned: 1 in 0.863s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:56:13 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Temporary image 90ce4227-e30d-4e8f-899d-a2d5cb37437c is fetched for user 79891c3a16e14cd9bbe28b4230b1c9dd. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 23:56:13 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4547d582-1cdd-423e-9a8a-d216319cb239]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:13 devstack sudo[95364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD
Jul 03 23:56:13 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:13 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a" returned: 0 in 0.920s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:13 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a is being set with open permissions: ugo+rw
Jul 03 23:56:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:13 devstack sudo[95369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a
Jul 03 23:56:13 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:14 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD" returned: 0 in 0.970s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:14 devstack sudo[95373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD
Jul 03 23:56:14 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:14 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a" returned: 0 in 0.751s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.706s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.957s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9e8713f1-deed-46b7-ac9e-7278a8624aea,created_at=2026-07-03T21:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1477180205',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9e8713f1-deed-46b7-ac9e-7278a8624aea,host='devstack@QuobyteHD#QuobyteHD',id=e9d18a4c-4e58-4694-87ee-d327ad077e0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1eab7b26d1643129637efde1acea67e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:12Z,use_quota=True,user_id='d82a2c3f5988443886ba2b00657f919a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28b3ba7d-6ae8-47bd-8f21-5f92df866a5f),volume_type_id=28b3ba7d-6ae8-47bd-8f21-5f92df866a5f)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Creating volume e9d18a4c-4e58-4694-87ee-d327ad077e0a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:14 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:56:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:14 devstack sudo[95379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a 1073741824
Jul 03 23:56:14 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:14 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4eb24509-a54b-4452-bd6c-0c3120b22deb tempest-SnapshotsActionsTest-1976681278 None] Create snapshot completed successfully
Jul 03 23:56:15 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD" returned: 1 in 0.907s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Acquiring lock "cinder-68606957-98de-4095-8d91-5d1154dca17a-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-68606957-98de-4095-8d91-5d1154dca17a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Acquiring lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Acquiring lock "cinder-quobyte-68606957-98de-4095-8d91-5d1154dca17a" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-68606957-98de-4095-8d91-5d1154dca17a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Deleting offline snapshot 68606957-98de-4095-8d91-5d1154dca17a of volume a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] snapshot_file for this snap is: volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69ea29e-64e5-47d6-bf26-39fb9bb648df]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:15 devstack sudo[95402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a
Jul 03 23:56:15 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:15 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a 1073741824" returned: 0 in 1.137s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:15 devstack sudo[95405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a
Jul 03 23:56:15 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:16 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a" returned: 0 in 0.824s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[26699ec5-4878-4e44-aebf-080f40e6659f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:16 devstack sudo[95410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:16 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:16 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a" returned: 0 in 0.695s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.226s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406999cc-af03-4a91-bb9b-33a4cb69f2a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3fad4067fc3476d860656119de9e61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:11Z,use_quota=True,user_id='79891c3a16e14cd9bbe28b4230b1c9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Creating volume 406999cc-af03-4a91-bb9b-33a4cb69f2a2 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:16 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:16 devstack sudo[95413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 1073741824
Jul 03 23:56:16 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af66265a-b41f-4b2b-a88e-1fb686956905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea80c66-fa6d-4e86-ad6b-b0c6e35f9e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:16 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Volume volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a (e9d18a4c-4e58-4694-87ee-d327ad077e0a): created successfully
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ea80c66-fa6d-4e86-ad6b-b0c6e35f9e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Flow 'volume_create_manager' (f9aa2d41-0c4e-462e-a3fe-f2bf79f413cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:16 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-bb46aedc-5ad0-46a5-9f20-66e803cc6f9a tempest-GroupSnapshotsV319Test-1004070803 None] Created volume successfully.
Jul 03 23:56:17 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 0.892s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:17 devstack sudo[95423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a
Jul 03 23:56:17 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:17 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 1073741824" returned: 0 in 0.850s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:17 devstack sudo[95425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2
Jul 03 23:56:17 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:18 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] GroupSnapshot 3f84462c-69e0-4fd8-8f0e-2e4817d4d2ef: creating.
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] Group snapshot 3f84462c-69e0-4fd8-8f0e-2e4817d4d2ef: creating. {{(pid=86648) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:18 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a" returned: 0 in 0.931s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:18 devstack sudo[95432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a
Jul 03 23:56:18 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2" returned: 0 in 0.823s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:18 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.243s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] Creating offline snapshot 9662f59b-ec05-4b75-bdef-af927d53abf3 of volume e9d18a4c-4e58-4694-87ee-d327ad077e0a {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3069af-6b5c-433b-8289-2815504823bf]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Attempting download of 90ce4227-e30d-4e8f-899d-a2d5cb37437c ((None, [{'url': 'file:///opt/stack/data/glance/images/90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'metadata': {}}])) to volume 406999cc-af03-4a91-bb9b-33a4cb69f2a2. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[795438c2-9be2-471b-930b-ee2c9341dcbf]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ce4227-e30d-4e8f-899d-a2d5cb37437c_dp88f4w3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:18 devstack sudo[95446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a
Jul 03 23:56:18 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:18 devstack sudo[95451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ce4227-e30d-4e8f-899d-a2d5cb37437c_dp88f4w3
Jul 03 23:56:18 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:19 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.68606957-98de-4095-8d91-5d1154dca17a" returned: 0 in 1.040s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-68606957-98de-4095-8d91-5d1154dca17a" released by "_delete_snapshot" :: held 3.855s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" released by "delete_snapshot" :: held 3.881s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:19 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Created reservations ['742b53dd-70cb-498b-b166-0a50f8565633', '3d2ef0f1-316d-40f7-9500-e092dca89728', 'e25de379-8460-412c-a1b4-e613951627e3', '48b8d493-2cc8-4d7d-aeff-60cc00275dc5'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:19 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Delete snapshot completed successfully.
Jul 03 23:56:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0c873520-38ba-4015-bbad-40d42f20d25b tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-68606957-98de-4095-8d91-5d1154dca17a-delete_snapshot" released by "delete_snapshot" :: held 4.120s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:19 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a" returned: 0 in 1.243s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:19 devstack sudo[95493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3 1G
Jul 03 23:56:19 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:19 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ce4227-e30d-4e8f-899d-a2d5cb37437c_dp88f4w3" returned: 0 in 1.188s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ce4227-e30d-4e8f-899d-a2d5cb37437c_dp88f4w3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:19 devstack sudo[95495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ce4227-e30d-4e8f-899d-a2d5cb37437c_dp88f4w3
Jul 03 23:56:19 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:20 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3 1G" returned: 0 in 0.942s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:20 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ce4227-e30d-4e8f-899d-a2d5cb37437c_dp88f4w3" returned: 1 in 0.879s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ce4227-e30d-4e8f-899d-a2d5cb37437c_dp88f4w3' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:56:20 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c5b2ec-58b6-4e11-87d2-b192b0144769]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:20 devstack sudo[95523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3
Jul 03 23:56:20 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:20 devstack sudo[95525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD
Jul 03 23:56:20 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:21 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3" returned: 0 in 0.780s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:21 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:56:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:21 devstack sudo[95532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3
Jul 03 23:56:21 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:21 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD" returned: 0 in 0.896s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:21 devstack sudo[95536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD
Jul 03 23:56:21 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:22 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3" returned: 0 in 0.713s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:22 devstack sudo[95539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.info
Jul 03 23:56:22 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:22 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD" returned: 1 in 0.869s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:56:22 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] 90ce4227-e30d-4e8f-899d-a2d5cb37437c was raw, converting to raw {{(pid=86648) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 23:56:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:22 devstack sudo[95544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2
Jul 03 23:56:22 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:22 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.info" returned: 0 in 0.764s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:22 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:56:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:22 devstack sudo[95547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.info
Jul 03 23:56:22 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:23 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2" returned: 0 in 0.783s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:23 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90ce4227-e30d-4e8f-899d-a2d5cb37437c_s9rgm5z7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:56:23 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Converted 0.00 MB image at 0.00 MB/s
Jul 03 23:56:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:23 devstack sudo[95552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 1G
Jul 03 23:56:23 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:23 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.info" returned: 0 in 0.778s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.437s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.659s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:23 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=122,cinder:UPDATE=157,cinder:INSERT=37,cinder:DELETE=11 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:56:23 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=124,cinder:UPDATE=150,cinder:INSERT=37,cinder:DELETE=12 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:56:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] Creating offline snapshot 715daf29-e0c9-45ab-86e7-d2d0f4af66a1 of volume a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:56:23 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[774f893c-cef7-4fef-b04b-7b5084b501a7]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:24 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2090e02a-d6ed-4085-b47e-220c45522e2a tempest-GroupSnapshotsV319Test-1004070803 None] group_snapshot 3f84462c-69e0-4fd8-8f0e-2e4817d4d2ef: created successfully
Jul 03 23:56:24 devstack sudo[95561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:24 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:24 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 1G" returned: 0 in 0.992s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:24 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacc2c03-ab9c-4961-96cd-943e4e7f653d]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:24 devstack sudo[95566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2
Jul 03 23:56:24 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:25 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 1.149s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:25 devstack sudo[95572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1 1G
Jul 03 23:56:25 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:25 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] group_snapshot 3f84462c-69e0-4fd8-8f0e-2e4817d4d2ef: deleting
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] group_snapshot 3f84462c-69e0-4fd8-8f0e-2e4817d4d2ef: deleting {{(pid=86648) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Acquiring lock "cinder-quobyte-e9d18a4c-4e58-4694-87ee-d327ad077e0a" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Lock "cinder-quobyte-e9d18a4c-4e58-4694-87ee-d327ad077e0a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Acquiring lock "cinder-quobyte-9662f59b-ec05-4b75-bdef-af927d53abf3" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Lock "cinder-quobyte-9662f59b-ec05-4b75-bdef-af927d53abf3" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Deleting offline snapshot 9662f59b-ec05-4b75-bdef-af927d53abf3 of volume e9d18a4c-4e58-4694-87ee-d327ad077e0a {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] snapshot_file for this snap is: volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[72830585-2c8e-4054-af7c-09f6ef25e5c7]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:25 devstack sudo[95575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3
Jul 03 23:56:25 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:25 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2" returned: 0 in 1.505s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:25 devstack sudo[95579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2
Jul 03 23:56:25 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:26 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1 1G" returned: 0 in 1.271s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:26 devstack sudo[95588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1
Jul 03 23:56:26 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:26 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3" returned: 0 in 1.129s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[30822336-30f9-491d-85e3-8b2d18d35294]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:26 devstack sudo[95592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a
Jul 03 23:56:26 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:26 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2" returned: 1 in 1.104s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Downloaded image 90ce4227-e30d-4e8f-899d-a2d5cb37437c ((None, [{'url': 'file:///opt/stack/data/glance/images/90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'metadata': {}}])) to volume 406999cc-af03-4a91-bb9b-33a4cb69f2a2 successfully. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Temporary image 90ce4227-e30d-4e8f-899d-a2d5cb37437c for user 79891c3a16e14cd9bbe28b4230b1c9dd is deleted. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Marking volume 406999cc-af03-4a91-bb9b-33a4cb69f2a2 as bootable. {{(pid=86648) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Copying metadata from image 90ce4227-e30d-4e8f-899d-a2d5cb37437c to 406999cc-af03-4a91-bb9b-33a4cb69f2a2. {{(pid=86648) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Creating volume glance metadata for volume 406999cc-af03-4a91-bb9b-33a4cb69f2a2 backed by image 90ce4227-e30d-4e8f-899d-a2d5cb37437c with: {'image_id': '90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c9745d8118c6516971762b86d34095c3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86648) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 23:56:26 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a837e6f-6941-49f0-abeb-b29b378cb996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2', 'volume_size': 1, 'image_id': '90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c9745d8118c6516971762b86d34095c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3fad4067fc3476d860656119de9e61f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '191ed8cb20f4a3aaa79627ba8752e2a7af542b7d25ab5eb20ced33e8546136c80385ede8fa9983c2922ed79fbf871fd98cfb5ff2f9b09a6f16d2ba3f602313a0', 'id': '90ce4227-e30d-4e8f-899d-a2d5cb37437c', 'created_at': datetime.datetime(2026, 7, 3, 21, 56, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 56, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ce4227-e30d-4e8f-899d-a2d5cb37437c/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c711b20>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39458f3c-69cf-4350-9034-e8963ee2b474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:27 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Volume volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 (406999cc-af03-4a91-bb9b-33a4cb69f2a2): created successfully
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39458f3c-69cf-4350-9034-e8963ee2b474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Flow 'volume_create_manager' (ff0c2178-c101-450f-af3d-d4bccae405ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d6bea99a-822d-4cdc-bde3-b499112877eb tempest-VolumeImageDependencyTests-1591365716 None] Created volume successfully.
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Acquiring lock "cinder-406999cc-af03-4a91-bb9b-33a4cb69f2a2-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:27 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Lock "cinder-406999cc-af03-4a91-bb9b-33a4cb69f2a2-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1" returned: 0 in 1.057s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:27 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1 is being set with open permissions: ugo+rw
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:27 devstack sudo[95599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Acquiring lock "cinder-quobyte-406999cc-af03-4a91-bb9b-33a4cb69f2a2" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:27 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Lock "cinder-quobyte-406999cc-af03-4a91-bb9b-33a4cb69f2a2" acquired by "delete_volume" :: waited 0.035s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[256c41c0-16c9-40c1-a0c6-582ac6c29432]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:27 devstack sudo[95603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2
Jul 03 23:56:27 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:27 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a" returned: 0 in 1.286s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:27 devstack sudo[95609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3
Jul 03 23:56:27 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:28 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1" returned: 0 in 0.899s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.609s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:28 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9d13c5e4-61bd-4a62-a525-c623952d3de2 tempest-SnapshotsActionsTest-1976681278 None] Create snapshot completed successfully
Jul 03 23:56:28 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Acquiring lock "cinder-715daf29-e0c9-45ab-86e7-d2d0f4af66a1-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2" returned: 0 in 1.135s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-715daf29-e0c9-45ab-86e7-d2d0f4af66a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Acquiring lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Acquiring lock "cinder-quobyte-715daf29-e0c9-45ab-86e7-d2d0f4af66a1" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-715daf29-e0c9-45ab-86e7-d2d0f4af66a1" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Deleting offline snapshot 715daf29-e0c9-45ab-86e7-d2d0f4af66a1 of volume a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] snapshot_file for this snap is: volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0d0931-f9d8-4b26-89d4-eaa67ad12242]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:28 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3" returned: 0 in 0.961s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:28 devstack sudo[95625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2
Jul 03 23:56:28 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:28 devstack sudo[95627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3
Jul 03 23:56:28 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:29 devstack sudo[95626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1
Jul 03 23:56:29 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:29 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a.9662f59b-ec05-4b75-bdef-af927d53abf3" returned: 0 in 0.711s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:29 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Lock "cinder-quobyte-9662f59b-ec05-4b75-bdef-af927d53abf3" released by "_delete_snapshot" :: held 4.245s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:29 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:29 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Lock "cinder-quobyte-e9d18a4c-4e58-4694-87ee-d327ad077e0a" released by "delete_snapshot" :: held 4.286s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2" returned: 1 in 0.946s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:56:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:29 devstack sudo[95635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2
Jul 03 23:56:29 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:29 devstack cinder-volume[86648]: WARNING cinder.quota [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1250528661 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1250528661, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:56:29 devstack cinder-volume[86648]: WARNING cinder.quota [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1250528661 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1250528661, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:56:29 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] Created reservations ['4e86b7fb-d9ce-4139-9822-f1abab27336e', '6c0d6b1d-fada-42aa-ad5d-7c0a3fc33eb9', '2e149615-8d4a-479d-89c0-5d335452c515', '55c85381-a99b-446a-af81-d4d94ca2a346'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:29 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1d12e13a-ae3e-433a-b127-8bec78157f26 tempest-GroupSnapshotsV319Test-1004070803 None] group_snapshot 3f84462c-69e0-4fd8-8f0e-2e4817d4d2ef: deleted successfully
Jul 03 23:56:29 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1" returned: 0 in 1.108s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d64af7-620a-4138-835d-bebf2f397199]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:30 devstack sudo[95641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:30 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:30 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-406999cc-af03-4a91-bb9b-33a4cb69f2a2" returned: 0 in 0.719s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Lock "cinder-quobyte-406999cc-af03-4a91-bb9b-33a4cb69f2a2" released by "delete_volume" :: held 2.880s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Created reservations ['624b1977-a01e-4749-b98a-c6123f2a7007', '1c0faf3f-a8a4-4e53-a35f-2423fc26ed59', '5e00d152-ad10-4ada-b0be-7eb4f8544f68', '3ba4a5ce-0a05-4e55-85c7-e6777264ed37'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:30 devstack sudo[95645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:56:30 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:30 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 0.802s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:30 devstack sudo[95650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1
Jul 03 23:56:30 devstack sudo[95650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Acquiring lock "cinder-quobyte-e9d18a4c-4e58-4694-87ee-d327ad077e0a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:31 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.843s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:31 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Lock "cinder-quobyte-e9d18a4c-4e58-4694-87ee-d327ad077e0a" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:31 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Deleted volume successfully.
Jul 03 23:56:31 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1720e8-a0f8-4054-87f6-60c6786c888f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1aae8428-1527-46d6-8549-34f8591157fb tempest-VolumeImageDependencyTests-1591365716 None] Lock "cinder-406999cc-af03-4a91-bb9b-33a4cb69f2a2-delete_volume" released by "delete_volume" :: held 4.168s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:31 devstack sudo[95654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a
Jul 03 23:56:31 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:32 devstack sudo[95650]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1" returned: 0 in 1.202s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:32 devstack sudo[95660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1
Jul 03 23:56:32 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:32 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a" returned: 0 in 1.006s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:32 devstack sudo[95666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a
Jul 03 23:56:32 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:33 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.715daf29-e0c9-45ab-86e7-d2d0f4af66a1" returned: 0 in 1.088s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-715daf29-e0c9-45ab-86e7-d2d0f4af66a1" released by "_delete_snapshot" :: held 4.334s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" released by "delete_snapshot" :: held 4.380s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Created reservations ['40833e74-a288-463b-be1e-d52444207780', '00191211-834c-4600-b531-c69d839f48c3', '017bd2c9-b7ab-4ca9-8abf-19ceaec809f6', 'e74f1bec-43bf-4f54-8577-514abca3a86d'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:33 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Delete snapshot completed successfully.
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-310f645d-d869-493d-bc1e-334daaf3dba2 tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-715daf29-e0c9-45ab-86e7-d2d0f4af66a1-delete_snapshot" released by "delete_snapshot" :: held 4.586s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:33 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9d18a4c-4e58-4694-87ee-d327ad077e0a" returned: 0 in 0.974s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Lock "cinder-quobyte-e9d18a4c-4e58-4694-87ee-d327ad077e0a" released by "delete_volume" :: held 2.105s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Created reservations ['15c34f8f-65c9-434b-b0e5-97de3852e585'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:33 devstack cinder-volume[86648]: WARNING cinder.quota [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1250528661 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1250528661, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Created reservations ['293f08e2-7b77-434c-b274-8a5b4b976397', '3b3f1dfb-69b8-49e9-9580-0057e268d32e', 'd1500786-d3ec-4740-b179-fcafe5d147b7', 'cd6477e9-a659-46da-9e8e-bfd5e4e1e254'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:33 devstack sudo[95689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:56:33 devstack sudo[95689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] Creating offline snapshot 859f8d94-902b-47ac-8a64-163d2093b578 of volume a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:56:34 devstack sudo[95689]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.788s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:34 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e0c946d4-a80e-4cc8-95e7-afac8d15c053 tempest-GroupSnapshotsV319Test-1004070803 None] Delete group completed successfully.
Jul 03 23:56:34 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[369d1c65-b8a0-49f8-b9c9-a5dbf595de26]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:34 devstack sudo[95692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:34 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:35 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 0.951s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:35 devstack sudo[95697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578 1G
Jul 03 23:56:35 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Flow 'volume_create_manager' (3b61d9ea-dedb-454c-9f7a-a04db1566195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5640ae1-19d7-4596-b7af-45e5b522e963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5640ae1-19d7-4596-b7af-45e5b522e963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a5879e-c471-4e2d-a0dc-03642c0a2081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5852e7dbb62b423ba6a90f7b00479f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:36Z,use_quota=True,user_id='955aa882a6db4088b6f962cd9a69ffe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63c1aaf-b91f-4c3c-bc57-f47ec6af2666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63c1aaf-b91f-4c3c-bc57-f47ec6af2666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c28229-56a5-44ec-a28e-59a8c60fcc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c28229-56a5-44ec-a28e-59a8c60fcc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a5879e-c471-4e2d-a0dc-03642c0a2081', 'volume_name': 'volume-52a5879e-c471-4e2d-a0dc-03642c0a2081', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b007985d-46e0-4d2b-88d1-f454aa8f9294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b007985d-46e0-4d2b-88d1-f454aa8f9294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4990b59-76c7-491e-acc6-40b86761c74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:35 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Volume 52a5879e-c471-4e2d-a0dc-03642c0a2081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a5879e-c471-4e2d-a0dc-03642c0a2081', 'volume_size': 1}
Jul 03 23:56:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:36 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578 1G" returned: 0 in 0.919s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:36 devstack sudo[95702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578
Jul 03 23:56:36 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:37 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578" returned: 0 in 0.701s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:37 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578 is being set with open permissions: ugo+rw
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:37 devstack sudo[95707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578
Jul 03 23:56:37 devstack sudo[95707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:37 devstack sudo[95707]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578" returned: 0 in 0.691s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.399s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.215s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a5879e-c471-4e2d-a0dc-03642c0a2081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5852e7dbb62b423ba6a90f7b00479f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:36Z,use_quota=True,user_id='955aa882a6db4088b6f962cd9a69ffe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Creating volume 52a5879e-c471-4e2d-a0dc-03642c0a2081 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:37 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:56:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-52a5879e-c471-4e2d-a0dc-03642c0a2081 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:37 devstack sudo[95710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-52a5879e-c471-4e2d-a0dc-03642c0a2081 1073741824
Jul 03 23:56:37 devstack sudo[95710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:37 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9e5edcf7-4028-4db2-a531-982432940e2b tempest-SnapshotsActionsTest-1976681278 None] Create snapshot completed successfully
Jul 03 23:56:38 devstack sudo[95710]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-52a5879e-c471-4e2d-a0dc-03642c0a2081 1073741824" returned: 0 in 0.847s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-52a5879e-c471-4e2d-a0dc-03642c0a2081 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Acquiring lock "cinder-859f8d94-902b-47ac-8a64-163d2093b578-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:38 devstack sudo[95716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-52a5879e-c471-4e2d-a0dc-03642c0a2081
Jul 03 23:56:38 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-859f8d94-902b-47ac-8a64-163d2093b578-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Acquiring lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Acquiring lock "cinder-quobyte-859f8d94-902b-47ac-8a64-163d2093b578" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-859f8d94-902b-47ac-8a64-163d2093b578" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Deleting offline snapshot 859f8d94-902b-47ac-8a64-163d2093b578 of volume a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:56:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] snapshot_file for this snap is: volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:56:38 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43fe935-16ab-429d-b17a-912736496445]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:39 devstack sudo[95718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578
Jul 03 23:56:39 devstack sudo[95718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f8dbcdad-8b0e-4501-bc93-daffa27cb848 tempest-GroupsV314Test-686408797 None] Group tempest-GroupsV314Test-Group-656707012: creating
Jul 03 23:56:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f8dbcdad-8b0e-4501-bc93-daffa27cb848 tempest-GroupsV314Test-686408797 None] Group tempest-GroupsV314Test-Group-656707012: created successfully
Jul 03 23:56:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f8dbcdad-8b0e-4501-bc93-daffa27cb848 tempest-GroupsV314Test-686408797 None] Create group completed successfully.
Jul 03 23:56:39 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-52a5879e-c471-4e2d-a0dc-03642c0a2081" returned: 0 in 0.664s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4990b59-76c7-491e-acc6-40b86761c74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a5879e-c471-4e2d-a0dc-03642c0a2081', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e775e3-25d7-4873-9e62-2e7aee02b4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:39 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Volume volume-52a5879e-c471-4e2d-a0dc-03642c0a2081 (52a5879e-c471-4e2d-a0dc-03642c0a2081): created successfully
Jul 03 23:56:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e775e3-25d7-4873-9e62-2e7aee02b4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Flow 'volume_create_manager' (3b61d9ea-dedb-454c-9f7a-a04db1566195) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5dd5d597-fb93-4eb0-85d4-c7e861bef06a tempest-CinderUnicodeTest-1907012136 None] Created volume successfully.
Jul 03 23:56:39 devstack sudo[95718]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578" returned: 0 in 0.815s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:39 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cdd28df-3431-4005-b777-a9749d8c9637]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:39 devstack sudo[95724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:39 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Flow 'volume_create_manager' (6b9c85ca-3916-4a3d-b5ac-6a8d5d46c2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e591a9c-3102-4037-802a-1b7eb40eed0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e591a9c-3102-4037-802a-1b7eb40eed0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1912409796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1b148e-5edc-43a1-b4a9-ad6ef366eb42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5852e7dbb62b423ba6a90f7b00479f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:40Z,use_quota=True,user_id='955aa882a6db4088b6f962cd9a69ffe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1ed6f0-f551-483b-bacb-eaaf967df595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d1ed6f0-f551-483b-bacb-eaaf967df595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7224ab6-885d-4e1c-9846-c40aca3e1835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7224ab6-885d-4e1c-9846-c40aca3e1835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba1b148e-5edc-43a1-b4a9-ad6ef366eb42', 'volume_name': 'volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06764f7-acc3-467c-9802-02dee56fc525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06764f7-acc3-467c-9802-02dee56fc525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49db4750-3685-4820-aabd-2e3a885fd659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:40 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Volume ba1b148e-5edc-43a1-b4a9-ad6ef366eb42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42', 'volume_size': 1}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1912409796',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1b148e-5edc-43a1-b4a9-ad6ef366eb42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5852e7dbb62b423ba6a90f7b00479f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:40Z,use_quota=True,user_id='955aa882a6db4088b6f962cd9a69ffe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Creating volume ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:40 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:40 devstack sudo[95729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 1073741824
Jul 03 23:56:40 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:40 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 0.987s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:40 devstack sudo[95732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578
Jul 03 23:56:40 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Flow 'volume_create_manager' (4d2d6d10-3771-479f-bfd6-d013ae7a2098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c7e918-9572-4f6c-92c4-31a0d98ef63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c7e918-9572-4f6c-92c4-31a0d98ef63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1408306491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=433d0129-12dc-44f7-9e87-5573f81f412e,host='devstack@QuobyteHD#QuobyteHD',id=803e2197-2347-468d-a0b3-4102615865ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130232b7b5ce473f8165ed21e3c5f8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:41Z,use_quota=True,user_id='7a9e345aec36410cbddbc1a9e4a436e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cd02e2-b4cc-4ae6-a93c-75ba1edb6f6c),volume_type_id=13cd02e2-b4cc-4ae6-a93c-75ba1edb6f6c)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d343ab-3c92-4d45-91e8-bfded16c6750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d343ab-3c92-4d45-91e8-bfded16c6750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfcf61b-bd05-4fb7-b8c9-36d5b09b4625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfcf61b-bd05-4fb7-b8c9-36d5b09b4625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '803e2197-2347-468d-a0b3-4102615865ce', 'volume_name': 'volume-803e2197-2347-468d-a0b3-4102615865ce', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a8731d-2237-4ee5-877c-1480579c8704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2a8731d-2237-4ee5-877c-1480579c8704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6ffd30-4901-43a7-b957-5c9d5ef2597d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:41 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Volume 803e2197-2347-468d-a0b3-4102615865ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-803e2197-2347-468d-a0b3-4102615865ce', 'volume_size': 1}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:41 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 1073741824" returned: 0 in 1.009s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:41 devstack sudo[95740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42
Jul 03 23:56:41 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:41 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578" returned: 0 in 1.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:41 devstack sudo[95742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578
Jul 03 23:56:41 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:42 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42" returned: 0 in 0.769s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.240s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=433d0129-12dc-44f7-9e87-5573f81f412e,created_at=2026-07-03T21:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1408306491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=433d0129-12dc-44f7-9e87-5573f81f412e,host='devstack@QuobyteHD#QuobyteHD',id=803e2197-2347-468d-a0b3-4102615865ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='130232b7b5ce473f8165ed21e3c5f8c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:41Z,use_quota=True,user_id='7a9e345aec36410cbddbc1a9e4a436e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13cd02e2-b4cc-4ae6-a93c-75ba1edb6f6c),volume_type_id=13cd02e2-b4cc-4ae6-a93c-75ba1edb6f6c)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Creating volume 803e2197-2347-468d-a0b3-4102615865ce {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:42 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49db4750-3685-4820-aabd-2e3a885fd659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:42 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce 1073741824
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb7aabd-09f5-4802-bbe9-3d911f67a7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:42 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:42 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Volume volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 (ba1b148e-5edc-43a1-b4a9-ad6ef366eb42): created successfully
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb7aabd-09f5-4802-bbe9-3d911f67a7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Flow 'volume_create_manager' (6b9c85ca-3916-4a3d-b5ac-6a8d5d46c2ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-12b1d022-d2b1-476e-bdef-db86db42df2b tempest-CinderUnicodeTest-1907012136 None] Created volume successfully.
Jul 03 23:56:42 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.859f8d94-902b-47ac-8a64-163d2093b578" returned: 0 in 0.697s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-859f8d94-902b-47ac-8a64-163d2093b578" released by "_delete_snapshot" :: held 3.638s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" released by "delete_snapshot" :: held 3.673s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Created reservations ['054fd56d-9049-43d4-8aad-caad9a110d87', 'c21b7d16-296d-431c-bce0-49e5b735a239', 'c0921839-0514-4c90-8171-6a2edcb04c7c', 'aa4361ac-fde3-4472-b007-6895b3e9fa3a'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Delete snapshot completed successfully.
Jul 03 23:56:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9f36b1b-9f21-4094-8727-594849180241 tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-859f8d94-902b-47ac-8a64-163d2093b578-delete_snapshot" released by "delete_snapshot" :: held 3.809s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:43 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce 1073741824" returned: 0 in 0.801s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:43 devstack sudo[95752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce
Jul 03 23:56:43 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:43 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce" returned: 0 in 0.713s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.524s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] Creating offline snapshot 982a0bb9-96ba-4f53-b013-504e22e4df09 of volume a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6ffd30-4901-43a7-b957-5c9d5ef2597d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-803e2197-2347-468d-a0b3-4102615865ce', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64615c67-94d4-45cd-bcae-1714bcb6c2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b365134c-30ef-40ba-bd4e-3e14031bc333]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:43 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Volume volume-803e2197-2347-468d-a0b3-4102615865ce (803e2197-2347-468d-a0b3-4102615865ce): created successfully
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64615c67-94d4-45cd-bcae-1714bcb6c2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Flow 'volume_create_manager' (4d2d6d10-3771-479f-bfd6-d013ae7a2098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8002e65b-c1dd-4d8d-abfc-116b070da4ae tempest-GroupsV314Test-686408797 None] Created volume successfully.
Jul 03 23:56:44 devstack sudo[95755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:44 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:44 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 0.788s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:44 devstack sudo[95762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09 1G
Jul 03 23:56:44 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Flow 'volume_create_manager' (e552708c-5923-4e1e-80cb-9f3a3a0154fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d6dc03-f10d-4e08-8a10-e5467815f49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d6dc03-f10d-4e08-8a10-e5467815f49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1959055517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f85a43-44d4-44d6-a93e-f36507a1eab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d804355887440baba5d93e9234db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:45Z,use_quota=True,user_id='0587b8917ce04950bce5d328ad9ca701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e606236-b823-4d5c-b089-c252a3b31e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e606236-b823-4d5c-b089-c252a3b31e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47f6d9c-a66e-4f5d-8c80-7739b1178f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47f6d9c-a66e-4f5d-8c80-7739b1178f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60f85a43-44d4-44d6-a93e-f36507a1eab6', 'volume_name': 'volume-60f85a43-44d4-44d6-a93e-f36507a1eab6', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29683658-4cd6-4fed-9780-c1384d3d0a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29683658-4cd6-4fed-9780-c1384d3d0a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d886df4-e345-4f51-8295-57fb9cf1c619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:45 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Volume 60f85a43-44d4-44d6-a93e-f36507a1eab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60f85a43-44d4-44d6-a93e-f36507a1eab6', 'volume_size': 1}
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:45 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09 1G" returned: 0 in 0.992s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:45 devstack sudo[95768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09
Jul 03 23:56:45 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:46 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09" returned: 0 in 0.656s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:46 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09 is being set with open permissions: ugo+rw
Jul 03 23:56:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:46 devstack sudo[95774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09
Jul 03 23:56:46 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:47 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09" returned: 0 in 0.629s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.157s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.317s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] Creating offline snapshot 8763814e-08e9-4ae7-b38e-16184183e293 of volume ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:56:47 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e4cf99c5-b10d-40cd-9350-0a089d27076e tempest-SnapshotsActionsTest-1976681278 None] Create snapshot completed successfully
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4972947-bed6-4b60-bc41-9023e7341adf]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:47 devstack sudo[95777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42
Jul 03 23:56:47 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Acquiring lock "cinder-982a0bb9-96ba-4f53-b013-504e22e4df09-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-982a0bb9-96ba-4f53-b013-504e22e4df09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Acquiring lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Acquiring lock "cinder-quobyte-982a0bb9-96ba-4f53-b013-504e22e4df09" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-982a0bb9-96ba-4f53-b013-504e22e4df09" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Deleting offline snapshot 982a0bb9-96ba-4f53-b013-504e22e4df09 of volume a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] snapshot_file for this snap is: volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[37924c82-18da-4e81-b1b0-217f83860d22]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:47 devstack sudo[95781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09
Jul 03 23:56:47 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:47 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42" returned: 0 in 0.803s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:47 devstack sudo[95784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293 1G
Jul 03 23:56:47 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:48 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09" returned: 0 in 0.786s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:48 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[888121ba-3f85-4e9b-af3a-af31b716cac1]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:48 devstack sudo[95792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:48 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:48 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293 1G" returned: 0 in 0.846s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:48 devstack sudo[95794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293
Jul 03 23:56:48 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:49 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 0.799s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:49 devstack sudo[95802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09
Jul 03 23:56:49 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:49 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293" returned: 0 in 0.702s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:49 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293 is being set with open permissions: ugo+rw
Jul 03 23:56:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:49 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293
Jul 03 23:56:49 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:50 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293" returned: 0 in 0.638s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:50 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:50 devstack sudo[95811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.info
Jul 03 23:56:50 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09" returned: 0 in 0.790s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:50 devstack sudo[95814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09
Jul 03 23:56:50 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:50 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.info" returned: 0 in 0.700s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:50 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.info is being set with open permissions: ugo+rw
Jul 03 23:56:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:50 devstack sudo[95818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.info
Jul 03 23:56:50 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:50 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.982a0bb9-96ba-4f53-b013-504e22e4df09" returned: 0 in 0.753s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-982a0bb9-96ba-4f53-b013-504e22e4df09" released by "_delete_snapshot" :: held 3.238s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" released by "delete_snapshot" :: held 3.264s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Created reservations ['b6086dc0-7492-4022-b57d-c28510b47a8c', 'a366ff07-f728-4816-b5f3-719a2e2b70a0', '567b1bc8-fdf0-4428-9a08-e6004f180989', '6797f004-bd9e-419f-aa12-d9679e905478'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:51 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Delete snapshot completed successfully.
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fbbf9516-46d0-4a03-8bbb-f5106d169fcd tempest-SnapshotsActionsTest-915038455 None] Lock "cinder-982a0bb9-96ba-4f53-b013-504e22e4df09-delete_snapshot" released by "delete_snapshot" :: held 3.417s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:51 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.info" returned: 0 in 0.715s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.513s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.053s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1959055517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f85a43-44d4-44d6-a93e-f36507a1eab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9d804355887440baba5d93e9234db52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:45Z,use_quota=True,user_id='0587b8917ce04950bce5d328ad9ca701',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Creating volume 60f85a43-44d4-44d6-a93e-f36507a1eab6 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:51 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:56:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60f85a43-44d4-44d6-a93e-f36507a1eab6 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:51 devstack sudo[95821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60f85a43-44d4-44d6-a93e-f36507a1eab6 1073741824
Jul 03 23:56:51 devstack sudo[95821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:51 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-64fe0bfe-8c5e-4057-8ae0-fab4222daa17 tempest-CinderUnicodeTest-1907012136 None] Create snapshot completed successfully
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "cinder-8763814e-08e9-4ae7-b38e-16184183e293-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-8763814e-08e9-4ae7-b38e-16184183e293-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "cinder-quobyte-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-quobyte-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "cinder-quobyte-8763814e-08e9-4ae7-b38e-16184183e293" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-quobyte-8763814e-08e9-4ae7-b38e-16184183e293" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Deleting offline snapshot 8763814e-08e9-4ae7-b38e-16184183e293 of volume ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] snapshot_file for this snap is: volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3205f3f0-2da1-4ea8-8fba-5e4132249034]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "cinder-e1e26ec0-ab29-4297-8b28-cde6c530cc87-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:52 devstack sudo[95826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293
Jul 03 23:56:52 devstack sudo[95826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Lock "cinder-e1e26ec0-ab29-4297-8b28-cde6c530cc87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "cinder-quobyte-e1e26ec0-ab29-4297-8b28-cde6c530cc87" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Lock "cinder-quobyte-e1e26ec0-ab29-4297-8b28-cde6c530cc87" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Deleting offline snapshot e1e26ec0-ab29-4297-8b28-cde6c530cc87 of volume a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] snapshot_file for this snap is: volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[20167ac4-c480-43f0-8b0b-00ad6150295f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:52 devstack sudo[95821]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60f85a43-44d4-44d6-a93e-f36507a1eab6 1073741824" returned: 0 in 1.001s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:52 devstack sudo[95829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:52 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60f85a43-44d4-44d6-a93e-f36507a1eab6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:52 devstack sudo[95831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60f85a43-44d4-44d6-a93e-f36507a1eab6
Jul 03 23:56:52 devstack sudo[95831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:53 devstack sudo[95826]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293" returned: 0 in 0.884s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1edf0f-2602-4fd9-b50a-c2f25b876a06]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:53 devstack sudo[95836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42
Jul 03 23:56:53 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:53 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 0.888s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a96813a0-4b98-4821-8d07-6c8c07c47343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:53 devstack sudo[95831]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60f85a43-44d4-44d6-a93e-f36507a1eab6" returned: 0 in 0.748s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.610s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:53 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Cloning volume 803e2197-2347-468d-a0b3-4102615865ce to volume d5f295b6-ac96-4065-b512-5542c02cca24
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a3dc8d-3af9-42a3-a3da-555c03f9e004]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d886df4-e345-4f51-8295-57fb9cf1c619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f85a43-44d4-44d6-a93e-f36507a1eab6', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329da5d8-d041-4ecc-9e51-5184c63b9033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:53 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Volume volume-60f85a43-44d4-44d6-a93e-f36507a1eab6 (60f85a43-44d4-44d6-a93e-f36507a1eab6): created successfully
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329da5d8-d041-4ecc-9e51-5184c63b9033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Flow 'volume_create_manager' (e552708c-5923-4e1e-80cb-9f3a3a0154fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Creating offline snapshot ad27528c-5820-4438-ac86-89a3bbed3881 of volume 803e2197-2347-468d-a0b3-4102615865ce {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:56:53 devstack sudo[95842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343
Jul 03 23:56:53 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:53 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-298b0925-02df-41ae-8c01-d0d37efd80f3 tempest-AttachVolumeShelveTestJSON-1127144584 None] Created volume successfully.
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b47995f-81ee-4fa3-a061-1f896d5b6bcf]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:53 devstack sudo[95844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce
Jul 03 23:56:53 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:54 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42" returned: 0 in 0.845s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:54 devstack sudo[95853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293
Jul 03 23:56:54 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:54 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343" returned: 0 in 0.968s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:54 devstack sudo[95861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:54 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:54 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce" returned: 0 in 0.888s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:54 devstack sudo[95863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881 1G
Jul 03 23:56:54 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:54 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293" returned: 0 in 0.880s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:54 devstack sudo[95869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293
Jul 03 23:56:54 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:55 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 0.980s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:55 devstack sudo[95878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87
Jul 03 23:56:55 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:55 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881 1G" returned: 0 in 1.131s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-803e2197-2347-468d-a0b3-4102615865ce -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:55 devstack sudo[95880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-803e2197-2347-468d-a0b3-4102615865ce -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881
Jul 03 23:56:55 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:55 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42.8763814e-08e9-4ae7-b38e-16184183e293" returned: 0 in 0.847s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-quobyte-8763814e-08e9-4ae7-b38e-16184183e293" released by "_delete_snapshot" :: held 3.578s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-quobyte-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42" released by "delete_snapshot" :: held 3.609s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:55 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Created reservations ['31738e78-a277-4d89-9208-7e07f4bc5d17', '4d81608d-5be5-4dc9-83ad-b668164ac930', 'd86242f2-bb4f-407d-aff4-2e6848cec1ae', '9020234d-62f0-4df1-b5f2-cfd7ea758354'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:55 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Delete snapshot completed successfully.
Jul 03 23:56:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6f8795a5-be23-4cc6-abfe-05972f749a05 tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-8763814e-08e9-4ae7-b38e-16184183e293-delete_snapshot" released by "delete_snapshot" :: held 3.773s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:56 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343.e1e26ec0-ab29-4297-8b28-cde6c530cc87" returned: 0 in 0.745s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Lock "cinder-quobyte-e1e26ec0-ab29-4297-8b28-cde6c530cc87" released by "_delete_snapshot" :: held 3.724s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" released by "delete_snapshot" :: held 3.752s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Created reservations ['9403e3a8-28c6-4dc7-8fe9-041e322d989d', '640cbd8e-54c0-40f6-a478-d5acc48622ee', '691730c5-84fb-4738-aecf-a1bb7a460852', 'e5b35aac-8a30-4deb-98e2-39bc78744ac4'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:56 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Delete snapshot completed successfully.
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7476d86d-d410-48c8-b5af-b87116fbaea3 tempest-SnapshotsActionsTest-1976681278 None] Lock "cinder-e1e26ec0-ab29-4297-8b28-cde6c530cc87-delete_snapshot" released by "delete_snapshot" :: held 3.926s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:56 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-803e2197-2347-468d-a0b3-4102615865ce -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881" returned: 0 in 0.752s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:56 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:56 devstack sudo[95887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881
Jul 03 23:56:56 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "cinder-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "cinder-quobyte-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-quobyte-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cfdd2e-6b96-465a-bf88-338faed232ce]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:56 devstack sudo[95889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42
Jul 03 23:56:56 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "cinder-a96813a0-4b98-4821-8d07-6c8c07c47343-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Lock "cinder-a96813a0-4b98-4821-8d07-6c8c07c47343-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" acquired by "delete_volume" :: waited 0.028s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:57 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5bf957-a0f6-4316-999a-551d7b0920c8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:57 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881" returned: 0 in 0.746s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:57 devstack sudo[95898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.info
Jul 03 23:56:57 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:57 devstack sudo[95897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343
Jul 03 23:56:57 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:57 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42" returned: 0 in 0.961s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:57 devstack sudo[95904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42
Jul 03 23:56:57 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:57 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.info" returned: 0 in 0.736s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:57 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:56:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:57 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343" returned: 0 in 0.831s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:57 devstack sudo[95910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.info
Jul 03 23:56:57 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:57 devstack sudo[95911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343
Jul 03 23:56:57 devstack sudo[95911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:58 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42" returned: 0 in 0.771s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-quobyte-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42" released by "delete_volume" :: held 1.809s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Created reservations ['a4109396-bc0e-4014-9feb-84761f29ddd9', 'b4a711f5-125f-4aeb-b1d2-9386c0883287', '8035a290-08d0-4ded-bb51-e8550b1b2e12', 'f043b49a-9e67-4c7f-b80e-5bde7bfb0bb1'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:58 devstack sudo[95915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:56:58 devstack sudo[95915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:58 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.info" returned: 0 in 0.722s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Acquiring lock "cinder-quobyte-d5f295b6-ac96-4065-b512-5542c02cca24" by "_copy_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Lock "cinder-quobyte-d5f295b6-ac96-4065-b512-5542c02cca24" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] snapshot: ad27528c-5820-4438-ac86-89a3bbed3881, volume: d5f295b6-ac96-4065-b512-5542c02cca24,  {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 23:56:58 devstack sudo[95911]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "cinder-52a5879e-c471-4e2d-a0dc-03642c0a2081-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a96813a0-4b98-4821-8d07-6c8c07c47343" returned: 0 in 0.830s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3789da37-5aab-4b45-87a7-d914ff571712]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Lock "cinder-quobyte-a96813a0-4b98-4821-8d07-6c8c07c47343" released by "delete_volume" :: held 1.759s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-52a5879e-c471-4e2d-a0dc-03642c0a2081-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "cinder-quobyte-52a5879e-c471-4e2d-a0dc-03642c0a2081" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Created reservations ['ad3bd474-73a2-422e-8735-524410c970f9', '954653d8-8d1c-416e-88f6-540c6ec45bf4', '6974317d-ef3b-4ff8-af8e-7229baf0e2bc', 'f0ddc4d1-ad32-45c4-a435-13c2776246dd'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-quobyte-52a5879e-c471-4e2d-a0dc-03642c0a2081" acquired by "delete_volume" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:58 devstack sudo[95919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881
Jul 03 23:56:58 devstack sudo[95919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e39c47f-6619-4510-9cb4-8b6e9281539c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-52a5879e-c471-4e2d-a0dc-03642c0a2081 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:58 devstack sudo[95922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:56:58 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:59 devstack sudo[95921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-52a5879e-c471-4e2d-a0dc-03642c0a2081
Jul 03 23:56:59 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:59 devstack sudo[95915]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.931s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:59 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:59 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Deleted volume successfully.
Jul 03 23:56:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-13e43d0b-c4a9-43e1-abbf-86edbc017fa8 tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-ba1b148e-5edc-43a1-b4a9-ad6ef366eb42-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:59 devstack sudo[95919]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881" returned: 0 in 1.157s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-803e2197-2347-468d-a0b3-4102615865ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] will copy from snapshot at /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 23:56:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Creating direct copy from snapshot {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 23:56:59 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f9a676-1d9b-4889-aa57-3d9a1a775769]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:59 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.022s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:59 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:59 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Deleted volume successfully.
Jul 03 23:57:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9a9dcef5-c755-4c75-a176-236f6e4ec6b4 tempest-SnapshotsActionsTest-1976681278 None] Lock "cinder-a96813a0-4b98-4821-8d07-6c8c07c47343-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:00 devstack sudo[95937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce
Jul 03 23:57:00 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:00 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-52a5879e-c471-4e2d-a0dc-03642c0a2081" returned: 0 in 1.264s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-52a5879e-c471-4e2d-a0dc-03642c0a2081 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:00 devstack sudo[95943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-52a5879e-c471-4e2d-a0dc-03642c0a2081
Jul 03 23:57:00 devstack sudo[95943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:00 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce" returned: 0 in 1.039s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:00 devstack cinder-volume[86648]: DEBUG cinder.utils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Path /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24 not found in is_blk_device check {{(pid=86648) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 23:57:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:00 devstack sudo[95950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24
Jul 03 23:57:01 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:01 devstack sudo[95943]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-52a5879e-c471-4e2d-a0dc-03642c0a2081" returned: 0 in 1.018s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-quobyte-52a5879e-c471-4e2d-a0dc-03642c0a2081" released by "delete_volume" :: held 2.328s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:01 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Created reservations ['5c9db3cb-bbfd-4c23-9e3b-1241f33d1e6c', 'f53a5548-662d-43cd-bed5-04b87caea886', 'f52c7bc4-eebc-4a89-ab80-ea82cd027ee4', 'f3e96d04-d2e1-4734-b80e-0828447f0512'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:01 devstack sudo[95953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:57:01 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:02 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.935s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:02 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:02 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Deleted volume successfully.
Jul 03 23:57:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9bbdfee4-117e-4f06-9aa7-85a3d4d7f9af tempest-CinderUnicodeTest-1907012136 None] Lock "cinder-52a5879e-c471-4e2d-a0dc-03642c0a2081-delete_volume" released by "delete_volume" :: held 3.711s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:57:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:05 devstack sudo[95967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:57:05 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:07 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.982s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:07 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:07 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:57:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:57:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:57:07 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24" returned: 0 in 6.491s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[92353386-e305-47ba-8d3e-cd86b7b5a61f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:07 devstack sudo[95972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce
Jul 03 23:57:07 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:08 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce" returned: 0 in 1.086s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:08 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:57:08 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Converted 1024.00 MB image at 157.73 MB/s
Jul 03 23:57:08 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:57:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:08 devstack sudo[96012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24
Jul 03 23:57:08 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:09 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24" returned: 0 in 0.835s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Lock "cinder-quobyte-d5f295b6-ac96-4065-b512-5542c02cca24" released by "_copy_volume_from_snapshot" :: held 10.755s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Acquiring lock "cinder-quobyte-ad27528c-5820-4438-ac86-89a3bbed3881" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Lock "cinder-quobyte-ad27528c-5820-4438-ac86-89a3bbed3881" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Deleting offline snapshot ad27528c-5820-4438-ac86-89a3bbed3881 of volume 803e2197-2347-468d-a0b3-4102615865ce {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:57:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] snapshot_file for this snap is: volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:57:09 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[345a1799-e77f-4c73-b460-58f98c99cc78]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:09 devstack sudo[96017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881
Jul 03 23:57:09 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:10 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881" returned: 0 in 0.957s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-803e2197-2347-468d-a0b3-4102615865ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:57:10 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f0f9f7-46e5-4912-9cae-2c70923528ad]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:10 devstack sudo[96023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce
Jul 03 23:57:10 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce" returned: 0 in 1.134s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:11 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:11 devstack sudo[96031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881
Jul 03 23:57:11 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:12 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=89,cinder:SELECT=97,cinder:INSERT=29,cinder:DELETE=9 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:57:12 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881" returned: 0 in 1.169s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:12 devstack sudo[96053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881
Jul 03 23:57:12 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:13 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce.ad27528c-5820-4438-ac86-89a3bbed3881" returned: 0 in 0.789s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Lock "cinder-quobyte-ad27528c-5820-4438-ac86-89a3bbed3881" released by "_delete_snapshot" :: held 4.214s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.300s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-7f77a110-f506-485f-b29e-bcfbbdc5d656 tempest-GroupsV314Test-686408797 None] Create group from source-group-433d0129-12dc-44f7-9e87-5573f81f412e completed successfully.
Jul 03 23:57:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Acquiring lock "cinder-quobyte-d5f295b6-ac96-4065-b512-5542c02cca24" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Lock "cinder-quobyte-d5f295b6-ac96-4065-b512-5542c02cca24" acquired by "delete_volume" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:15 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda1ba03-047c-4d1b-87b7-1a6092b6df49]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:15 devstack sudo[96057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24
Jul 03 23:57:15 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-59519dba-3943-451e-92e0-158bbc453071 req-394322bd-a9a8-4436-9169-913a04db973f tempest-AttachVolumeShelveTestJSON-1127144584 None] No connector for attachment a6402fa9-ae82-49d2-9272-abc4cbf0931c; skipping storage backend terminate_connection call. {{(pid=86648) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 03 23:57:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-59519dba-3943-451e-92e0-158bbc453071 req-394322bd-a9a8-4436-9169-913a04db973f tempest-AttachVolumeShelveTestJSON-1127144584 None] Deleting attachment a6402fa9-ae82-49d2-9272-abc4cbf0931c. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:57:16 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24" returned: 0 in 0.982s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:16 devstack sudo[96062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24
Jul 03 23:57:16 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:17 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d5f295b6-ac96-4065-b512-5542c02cca24" returned: 0 in 0.890s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Lock "cinder-quobyte-d5f295b6-ac96-4065-b512-5542c02cca24" released by "delete_volume" :: held 1.944s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:17 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Created reservations ['2fe381bb-16a6-4ccb-ae50-a4d0e0da363b'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:17 devstack cinder-volume[86648]: WARNING cinder.quota [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1994833561 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1994833561, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:57:17 devstack cinder-volume[86648]: WARNING cinder.quota [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1994833561 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1994833561, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:57:17 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Created reservations ['f2c6fcd1-70c9-4cf6-9e3f-561555e1b139', 'b452e5fd-0527-4f2a-8973-955c278b1fef', '467aefa8-b050-420a-a1ee-db04d981d308', '7ce97e3e-01b3-489a-af1d-be5e425f3593'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:17 devstack sudo[96068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:57:17 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:18 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Acquiring lock "cinder-quobyte-803e2197-2347-468d-a0b3-4102615865ce" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:18 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Lock "cinder-quobyte-803e2197-2347-468d-a0b3-4102615865ce" acquired by "delete_volume" :: waited 0.031s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:18 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7785f6-82ae-4680-9b9b-87ba98406387]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:18 devstack sudo[96070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce
Jul 03 23:57:18 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:18 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.030s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:18 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:18 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cd0ecaeb-1767-458d-8d62-7c7e22ebf82b tempest-GroupsV314Test-686408797 None] Delete group completed successfully.
Jul 03 23:57:19 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce" returned: 0 in 1.101s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:19 devstack sudo[96076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce
Jul 03 23:57:19 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:20 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-803e2197-2347-468d-a0b3-4102615865ce" returned: 0 in 0.905s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Lock "cinder-quobyte-803e2197-2347-468d-a0b3-4102615865ce" released by "delete_volume" :: held 2.124s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:20 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Created reservations ['5ae4fafb-adc4-4d65-a604-3141244fc529'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:20 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Created reservations ['0c4fbe13-447c-476b-ac9b-21fabd5b188b', '8ff149b2-dbb3-46de-9d76-6353f4b94210', '663dc399-0a84-4d67-b635-6529ba91902d', '2bdc7143-2bb1-41ef-a698-cd6ef03ae39e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:20 devstack sudo[96080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:57:20 devstack sudo[96080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:21 devstack sudo[96080]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.827s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:21 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:21 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-3b8bc4ff-d6ba-4693-99a2-100f61ee7a20 tempest-GroupsV314Test-686408797 None] Delete group completed successfully.
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Flow 'volume_create_manager' (e4f697be-ad17-462b-b8d3-ceec7d6b86f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30095ac-3c17-48f5-80a1-e3cb0a3df44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30095ac-3c17-48f5-80a1-e3cb0a3df44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1146242538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0df2a3-ed5f-4d30-a33e-627196a17b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b258481bf9db43078c35bddd2a063bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:22Z,use_quota=True,user_id='bd26786324314b448484b02323525889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846bb731-9032-4bec-93f1-1e051bfa3987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846bb731-9032-4bec-93f1-1e051bfa3987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f644ce-db14-4cb4-8fb3-620306e539aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f644ce-db14-4cb4-8fb3-620306e539aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0df2a3-ed5f-4d30-a33e-627196a17b24', 'volume_name': 'volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20909a5d-c990-490b-9b8c-1e7689758772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20909a5d-c990-490b-9b8c-1e7689758772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ff1fcb-a295-483a-8616-f63b896fbb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:22 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Volume 5d0df2a3-ed5f-4d30-a33e-627196a17b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24', 'volume_size': 1}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1146242538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0df2a3-ed5f-4d30-a33e-627196a17b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b258481bf9db43078c35bddd2a063bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:22Z,use_quota=True,user_id='bd26786324314b448484b02323525889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Creating volume 5d0df2a3-ed5f-4d30-a33e-627196a17b24 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:57:22 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:57:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:22 devstack sudo[96083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24 1073741824
Jul 03 23:57:22 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:23 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24 1073741824" returned: 0 in 0.901s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:23 devstack sudo[96089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24
Jul 03 23:57:23 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:24 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24" returned: 0 in 0.703s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ff1fcb-a295-483a-8616-f63b896fbb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127f03c8-d03e-48bd-996a-c9b7e15514d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=108,cinder:UPDATE=131,cinder:INSERT=37,cinder:DELETE=4 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:57:24 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Volume volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24 (5d0df2a3-ed5f-4d30-a33e-627196a17b24): created successfully
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127f03c8-d03e-48bd-996a-c9b7e15514d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Flow 'volume_create_manager' (e4f697be-ad17-462b-b8d3-ceec7d6b86f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:24 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-49eab16c-cfc2-4ce8-a283-fdc9e0d87cf8 tempest-SnapshotMetadataTestJSON-1633894919 None] Created volume successfully.
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] Creating offline snapshot 679a6832-4479-433c-bc5b-8d40b60cee42 of volume 5d0df2a3-ed5f-4d30-a33e-627196a17b24 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[229eddfe-1bbd-4ef7-8b36-2a0e5f40ab3a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:25 devstack sudo[96098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24
Jul 03 23:57:25 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:25 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24" returned: 0 in 0.897s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:25 devstack sudo[96104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42 1G
Jul 03 23:57:25 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:26 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42 1G" returned: 0 in 0.877s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:26 devstack sudo[96110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42
Jul 03 23:57:26 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:27 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42" returned: 0 in 0.725s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:27 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42 is being set with open permissions: ugo+rw
Jul 03 23:57:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:27 devstack sudo[96115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42
Jul 03 23:57:27 devstack sudo[96115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:28 devstack sudo[96115]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42" returned: 0 in 0.810s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:28 devstack sudo[96118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.info
Jul 03 23:57:28 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:29 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.info" returned: 0 in 0.870s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:29 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.info is being set with open permissions: ugo+rw
Jul 03 23:57:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:29 devstack sudo[96123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.info
Jul 03 23:57:29 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:29 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.info" returned: 0 in 0.764s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.069s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:29 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1c7d6200-2581-4232-82a2-884487956698 tempest-SnapshotMetadataTestJSON-1633894919 None] Create snapshot completed successfully
Jul 03 23:57:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Acquiring lock "cinder-679a6832-4479-433c-bc5b-8d40b60cee42-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "cinder-679a6832-4479-433c-bc5b-8d40b60cee42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Acquiring lock "cinder-quobyte-5d0df2a3-ed5f-4d30-a33e-627196a17b24" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "cinder-quobyte-5d0df2a3-ed5f-4d30-a33e-627196a17b24" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Acquiring lock "cinder-quobyte-679a6832-4479-433c-bc5b-8d40b60cee42" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "cinder-quobyte-679a6832-4479-433c-bc5b-8d40b60cee42" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Deleting offline snapshot 679a6832-4479-433c-bc5b-8d40b60cee42 of volume 5d0df2a3-ed5f-4d30-a33e-627196a17b24 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:57:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] snapshot_file for this snap is: volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:57:31 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6bcc5f-371c-4afc-a7fc-5f9b181adcb0]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:31 devstack sudo[96155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42
Jul 03 23:57:31 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:32 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42" returned: 0 in 0.964s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:57:32 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[393d3dac-5a52-4061-b2e8-b6ee248a7ce8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:32 devstack sudo[96168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24
Jul 03 23:57:32 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:32 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24" returned: 0 in 0.934s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:33 devstack sudo[96175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42
Jul 03 23:57:33 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:33 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42" returned: 0 in 0.779s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:33 devstack sudo[96181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42
Jul 03 23:57:33 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:34 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24.679a6832-4479-433c-bc5b-8d40b60cee42" returned: 0 in 0.778s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "cinder-quobyte-679a6832-4479-433c-bc5b-8d40b60cee42" released by "_delete_snapshot" :: held 3.637s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "cinder-quobyte-5d0df2a3-ed5f-4d30-a33e-627196a17b24" released by "delete_snapshot" :: held 3.668s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:34 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Created reservations ['234df703-26b3-4aa0-a287-3decfa71c1f4', 'f11220fe-d76c-4fe5-a103-7ecb5c552c41', '1c0982cc-9f2e-4609-b78e-5ffb16980abe', '4740c9e8-3e03-4f0f-99ce-e5512b9fb743'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Delete snapshot completed successfully.
Jul 03 23:57:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c1c0d49-f6ff-4266-9f25-6ee41e0d20f2 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "cinder-679a6832-4479-433c-bc5b-8d40b60cee42-delete_snapshot" released by "delete_snapshot" :: held 3.892s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Acquiring lock "cinder-5d0df2a3-ed5f-4d30-a33e-627196a17b24-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "cinder-5d0df2a3-ed5f-4d30-a33e-627196a17b24-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Acquiring lock "cinder-quobyte-5d0df2a3-ed5f-4d30-a33e-627196a17b24" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "cinder-quobyte-5d0df2a3-ed5f-4d30-a33e-627196a17b24" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:35 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19bdab2-b95f-43ef-a675-cf50c15aa372]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:35 devstack sudo[96230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24
Jul 03 23:57:35 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:36 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24" returned: 0 in 0.788s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:36 devstack sudo[96254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24
Jul 03 23:57:36 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:36 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5d0df2a3-ed5f-4d30-a33e-627196a17b24" returned: 0 in 0.705s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "cinder-quobyte-5d0df2a3-ed5f-4d30-a33e-627196a17b24" released by "delete_volume" :: held 1.583s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:37 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Created reservations ['d96ab7f1-2136-4205-a42d-6e708c125efe', 'c225592f-3761-4dca-9a82-e99d9d7054c2', '7cf01629-1707-4088-afc7-c610f0e7f645', '35fcac2d-13d9-4cf7-930b-07f33f160d6f'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:37 devstack sudo[96259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:57:37 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:38 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.972s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:38 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Deleted volume successfully.
Jul 03 23:57:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ab066105-045f-46d8-9c4a-7d5e037b30d9 tempest-SnapshotMetadataTestJSON-1633894919 None] Lock "cinder-5d0df2a3-ed5f-4d30-a33e-627196a17b24-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Flow 'volume_create_manager' (ebc15040-64c5-45dc-8a88-da297ea6a19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ecdb13-4a70-4e0f-8477-7f6f8dd6ad7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65ecdb13-4a70-4e0f-8477-7f6f8dd6ad7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1834272039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8624b1d8-e67f-4a55-8184-5ec3ba72fba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25688b7c87e4f32906b06d0adc59565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:42Z,use_quota=True,user_id='8d0818cf44c7419f85ae63ece1f32fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3340b013-7328-4526-ac64-524f3df98c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3340b013-7328-4526-ac64-524f3df98c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86088b82-3130-47d0-b225-fd9399614b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86088b82-3130-47d0-b225-fd9399614b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8624b1d8-e67f-4a55-8184-5ec3ba72fba8', 'volume_name': 'volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e15fde-3205-44ab-a214-1fa11fd18bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e15fde-3205-44ab-a214-1fa11fd18bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5e2765-37d4-42d0-9e7a-cd47e3fe7935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:41 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Volume 8624b1d8-e67f-4a55-8184-5ec3ba72fba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8', 'volume_size': 1}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1834272039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8624b1d8-e67f-4a55-8184-5ec3ba72fba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25688b7c87e4f32906b06d0adc59565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:42Z,use_quota=True,user_id='8d0818cf44c7419f85ae63ece1f32fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Creating volume 8624b1d8-e67f-4a55-8184-5ec3ba72fba8 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:57:41 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:57:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:41 devstack sudo[96264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 1073741824
Jul 03 23:57:41 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:42 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 1073741824" returned: 0 in 0.999s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:42 devstack sudo[96270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8
Jul 03 23:57:42 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:43 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" returned: 0 in 0.646s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:57:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d5e2765-37d4-42d0-9e7a-cd47e3fe7935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ad22e7-1d66-4f34-8260-fe5e0bfeea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:43 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Volume volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 (8624b1d8-e67f-4a55-8184-5ec3ba72fba8): created successfully
Jul 03 23:57:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ad22e7-1d66-4f34-8260-fe5e0bfeea50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Flow 'volume_create_manager' (ebc15040-64c5-45dc-8a88-da297ea6a19d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:43 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5a9d0176-ce50-4405-b676-a08833d47dbf tempest-VolumesDeleteCascade-69068788 None] Created volume successfully.
Jul 03 23:57:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] Creating offline snapshot 33d0cd90-d4d9-46c8-9fb5-2436408af970 of volume 8624b1d8-e67f-4a55-8184-5ec3ba72fba8 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:57:43 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e9162a-52ad-497a-891d-527c337f3b09]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:44 devstack sudo[96273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8
Jul 03 23:57:44 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:44 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" returned: 0 in 0.866s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:44 devstack sudo[96279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 1G
Jul 03 23:57:44 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:45 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 1G" returned: 0 in 0.922s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:45 devstack sudo[96285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970
Jul 03 23:57:45 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:46 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970" returned: 0 in 0.843s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:46 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 is being set with open permissions: ugo+rw
Jul 03 23:57:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:46 devstack sudo[96291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970
Jul 03 23:57:46 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Flow 'volume_create_manager' (514881ee-532f-433c-9dab-bf2901588eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a73e86-cd4b-492c-9d47-7be0c4f38a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a73e86-cd4b-492c-9d47-7be0c4f38a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2095667513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35275961-cc47-4862-9576-8e45491b2e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e24f5fbb154542af8a25a29b57a4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:47Z,use_quota=True,user_id='4b46d4e9716a4a898dca27507ea09a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd17383b-ca98-4221-b5ee-ae1f36994c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd17383b-ca98-4221-b5ee-ae1f36994c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae158724-d6ca-4b4c-b777-7cca296c7744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae158724-d6ca-4b4c-b777-7cca296c7744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35275961-cc47-4862-9576-8e45491b2e91', 'volume_name': 'volume-35275961-cc47-4862-9576-8e45491b2e91', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58b31d3-e292-4867-8675-e3223a308cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58b31d3-e292-4867-8675-e3223a308cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6e350c-fb40-4e2c-949a-6af2b453ad31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:47 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Volume 35275961-cc47-4862-9576-8e45491b2e91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35275961-cc47-4862-9576-8e45491b2e91', 'volume_size': 1}
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:47 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970" returned: 0 in 0.761s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:47 devstack sudo[96294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.info
Jul 03 23:57:47 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:48 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.info" returned: 0 in 0.668s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:48 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.info is being set with open permissions: ugo+rw
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:48 devstack sudo[96297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.info
Jul 03 23:57:48 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:48 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.info" returned: 0 in 0.597s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.750s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.454s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2095667513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35275961-cc47-4862-9576-8e45491b2e91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e24f5fbb154542af8a25a29b57a4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:47Z,use_quota=True,user_id='4b46d4e9716a4a898dca27507ea09a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Creating volume 35275961-cc47-4862-9576-8e45491b2e91 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:57:48 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:57:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-35275961-cc47-4862-9576-8e45491b2e91 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:48 devstack sudo[96300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-35275961-cc47-4862-9576-8e45491b2e91 1073741824
Jul 03 23:57:48 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0b3796a6-f5ee-411b-922a-588b4d7693fa tempest-VolumesDeleteCascade-69068788 None] Create snapshot completed successfully
Jul 03 23:57:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:49 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-35275961-cc47-4862-9576-8e45491b2e91 1073741824" returned: 0 in 0.937s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-35275961-cc47-4862-9576-8e45491b2e91 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:49 devstack sudo[96308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-35275961-cc47-4862-9576-8e45491b2e91
Jul 03 23:57:49 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:50 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-35275961-cc47-4862-9576-8e45491b2e91" returned: 0 in 0.675s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:57:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.953s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6e350c-fb40-4e2c-949a-6af2b453ad31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35275961-cc47-4862-9576-8e45491b2e91', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651bd3bc-e65f-484f-8b0d-6fd39d67cd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] Creating offline snapshot 458fdb3a-a61b-4225-8faf-3e2c85497c48 of volume 8624b1d8-e67f-4a55-8184-5ec3ba72fba8 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:57:50 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Volume volume-35275961-cc47-4862-9576-8e45491b2e91 (35275961-cc47-4862-9576-8e45491b2e91): created successfully
Jul 03 23:57:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651bd3bc-e65f-484f-8b0d-6fd39d67cd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Flow 'volume_create_manager' (514881ee-532f-433c-9dab-bf2901588eec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:50 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c4ae16-ec12-4070-b5a2-19e68e9ee469]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:50 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-014bec0c-c589-4aa8-8c0d-0fbbc352087a tempest-VolumeQuotasAdminTestJSON-156037401 None] Created volume successfully.
Jul 03 23:57:50 devstack sudo[96312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970
Jul 03 23:57:50 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:51 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970" returned: 0 in 0.771s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:57:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:51 devstack sudo[96318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 1G
Jul 03 23:57:51 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Acquiring lock "cinder-35275961-cc47-4862-9576-8e45491b2e91-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "cinder-35275961-cc47-4862-9576-8e45491b2e91-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Acquiring lock "cinder-quobyte-35275961-cc47-4862-9576-8e45491b2e91" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "cinder-quobyte-35275961-cc47-4862-9576-8e45491b2e91" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:51 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0381c618-d6e2-44f8-b13b-67b897f7dc16]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-35275961-cc47-4862-9576-8e45491b2e91 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:51 devstack sudo[96320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-35275961-cc47-4862-9576-8e45491b2e91
Jul 03 23:57:51 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:52 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 1G" returned: 0 in 0.908s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:52 devstack sudo[96325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48
Jul 03 23:57:52 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:52 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-35275961-cc47-4862-9576-8e45491b2e91" returned: 0 in 0.841s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-35275961-cc47-4862-9576-8e45491b2e91 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:52 devstack sudo[96330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-35275961-cc47-4862-9576-8e45491b2e91
Jul 03 23:57:52 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:52 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48" returned: 0 in 0.760s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:52 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 is being set with open permissions: ugo+rw
Jul 03 23:57:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:52 devstack sudo[96336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48
Jul 03 23:57:52 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:53 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-35275961-cc47-4862-9576-8e45491b2e91" returned: 0 in 0.724s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "cinder-quobyte-35275961-cc47-4862-9576-8e45491b2e91" released by "delete_volume" :: held 1.615s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Created reservations ['b18c88d6-c214-4d15-8ca6-3d6ba1e3afb0', 'a5507946-af73-4586-bce0-44c6ccddd2ee', '6aba1aee-17e3-4f9d-a83e-6464f22e6671', '174ea1cc-c64a-4f57-a600-657e5d96bad9'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:53 devstack sudo[96339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:57:53 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:53 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48" returned: 0 in 0.689s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.276s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:53 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0bc81f55-1310-49f1-9870-f2853ff182dc tempest-VolumesDeleteCascade-69068788 None] Create snapshot completed successfully
Jul 03 23:57:53 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.717s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:53 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:54 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Deleted volume successfully.
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f1fe5833-cc6e-4565-8718-99fbcdbe5686 tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "cinder-35275961-cc47-4862-9576-8e45491b2e91-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Flow 'volume_create_manager' (425fcfa3-b306-49af-8b00-1cccfeee4903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e10edb-dea6-4a6d-a0a3-ad1c165bf07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48e10edb-dea6-4a6d-a0a3-ad1c165bf07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1229585456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03550d5-8020-40dd-b456-087f725c76d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e24f5fbb154542af8a25a29b57a4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:54Z,use_quota=True,user_id='4b46d4e9716a4a898dca27507ea09a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085f96fb-f0bf-40a1-bd62-432441b0ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085f96fb-f0bf-40a1-bd62-432441b0ec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9669b47e-5ef1-41ec-822a-10abb044e62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9669b47e-5ef1-41ec-822a-10abb044e62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03550d5-8020-40dd-b456-087f725c76d7', 'volume_name': 'volume-f03550d5-8020-40dd-b456-087f725c76d7', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56fefbc-4593-4214-8ccf-6f1bd50e46c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b56fefbc-4593-4214-8ccf-6f1bd50e46c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef03090-840c-4054-9223-4331c45caef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:54 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Volume f03550d5-8020-40dd-b456-087f725c76d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03550d5-8020-40dd-b456-087f725c76d7', 'volume_size': 1}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1229585456',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03550d5-8020-40dd-b456-087f725c76d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e24f5fbb154542af8a25a29b57a4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:54Z,use_quota=True,user_id='4b46d4e9716a4a898dca27507ea09a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Creating volume f03550d5-8020-40dd-b456-087f725c76d7 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:57:54 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f03550d5-8020-40dd-b456-087f725c76d7 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:54 devstack sudo[96343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f03550d5-8020-40dd-b456-087f725c76d7 1073741824
Jul 03 23:57:54 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-8624b1d8-e67f-4a55-8184-5ec3ba72fba8-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-8624b1d8-e67f-4a55-8184-5ec3ba72fba8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Performing cascade delete. {{(pid=86648) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-33d0cd90-d4d9-46c8-9fb5-2436408af970-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-33d0cd90-d4d9-46c8-9fb5-2436408af970-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-quobyte-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-quobyte-33d0cd90-d4d9-46c8-9fb5-2436408af970" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-33d0cd90-d4d9-46c8-9fb5-2436408af970" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Deleting offline snapshot 33d0cd90-d4d9-46c8-9fb5-2436408af970 of volume 8624b1d8-e67f-4a55-8184-5ec3ba72fba8 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] snapshot_file for this snap is: volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaef60f1-78e7-40a8-ae09-ae2531edb124]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:55 devstack sudo[96346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970
Jul 03 23:57:55 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:55 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f03550d5-8020-40dd-b456-087f725c76d7 1073741824" returned: 0 in 0.983s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f03550d5-8020-40dd-b456-087f725c76d7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:55 devstack sudo[96352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f03550d5-8020-40dd-b456-087f725c76d7
Jul 03 23:57:55 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:55 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970" returned: 0 in 0.867s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:57:55 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[03154bab-45dd-4e3d-9dbb-188e2ee0d462]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:55 devstack sudo[96357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8
Jul 03 23:57:55 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:56 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f03550d5-8020-40dd-b456-087f725c76d7" returned: 0 in 0.686s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:57:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef03090-840c-4054-9223-4331c45caef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03550d5-8020-40dd-b456-087f725c76d7', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5374b4bd-a0dd-410c-bdce-8aae3444b63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:56 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Volume volume-f03550d5-8020-40dd-b456-087f725c76d7 (f03550d5-8020-40dd-b456-087f725c76d7): created successfully
Jul 03 23:57:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5374b4bd-a0dd-410c-bdce-8aae3444b63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Flow 'volume_create_manager' (425fcfa3-b306-49af-8b00-1cccfeee4903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:56 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e5412a9b-7b84-4b28-a984-9655bc286a92 tempest-VolumeQuotasAdminTestJSON-156037401 None] Created volume successfully.
Jul 03 23:57:56 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" returned: 0 in 0.814s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:56 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2447ed-251b-4cc5-84d9-f2de5108d78c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:56 devstack sudo[96364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48
Jul 03 23:57:56 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:57 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0ea9e50e-f7fc-4285-be25-70a5d1a6024e tempest-VolumeQuotasAdminTestJSON-1173447911 None] Transfer volume completed successfully.
Jul 03 23:57:57 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48" returned: 0 in 0.781s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:57:57 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcceedb-da64-4d2d-87cb-83050fd8591a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:57 devstack sudo[96369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970
Jul 03 23:57:57 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Acquiring lock "cinder-f03550d5-8020-40dd-b456-087f725c76d7-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Lock "cinder-f03550d5-8020-40dd-b456-087f725c76d7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Acquiring lock "cinder-quobyte-f03550d5-8020-40dd-b456-087f725c76d7" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Lock "cinder-quobyte-f03550d5-8020-40dd-b456-087f725c76d7" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[545d0771-c72b-4ef0-b4de-87cb3446067d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f03550d5-8020-40dd-b456-087f725c76d7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:58 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970" returned: 0 in 0.819s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:57:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfc10c4-94c4-4614-a2b3-0730ef050519]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:58 devstack sudo[96381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f03550d5-8020-40dd-b456-087f725c76d7
Jul 03 23:57:58 devstack sudo[96381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:58 devstack sudo[96382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8
Jul 03 23:57:58 devstack sudo[96382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:59 devstack sudo[96381]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f03550d5-8020-40dd-b456-087f725c76d7" returned: 0 in 0.850s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f03550d5-8020-40dd-b456-087f725c76d7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:59 devstack sudo[96392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f03550d5-8020-40dd-b456-087f725c76d7
Jul 03 23:57:59 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:59 devstack sudo[96382]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" returned: 0 in 0.855s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:59 devstack sudo[96394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970
Jul 03 23:57:59 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:59 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f03550d5-8020-40dd-b456-087f725c76d7" returned: 0 in 0.679s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Lock "cinder-quobyte-f03550d5-8020-40dd-b456-087f725c76d7" released by "delete_volume" :: held 1.577s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Created reservations ['ea632c59-465e-4edf-9888-a5ea795e70b0', '844a5247-4a51-4c7c-80a1-9cd7af3f0362', '3f702bac-d528-4c4a-a5e4-245aa3011dac', '5beccedb-6d4c-4d7e-bdff-1a13227383fc'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:59 devstack sudo[96407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:57:59 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:59 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970" returned: 0 in 0.818s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:59 devstack sudo[96409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970
Jul 03 23:57:59 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:00 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.788s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:00 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:00 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Deleted volume successfully.
Jul 03 23:58:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9617c379-3ac3-4402-8d19-cc6b6509e183 tempest-VolumeQuotasAdminTestJSON-1861924444 None] Lock "cinder-f03550d5-8020-40dd-b456-087f725c76d7-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:00 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.33d0cd90-d4d9-46c8-9fb5-2436408af970" returned: 0 in 0.913s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 -F qcow2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:00 devstack sudo[96429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 -F qcow2
Jul 03 23:58:00 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:01 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 -F qcow2" returned: 0 in 0.811s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-33d0cd90-d4d9-46c8-9fb5-2436408af970" released by "_delete_snapshot" :: held 6.874s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" released by "delete_snapshot" :: held 6.902s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:01 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Created reservations ['2601bdec-5677-4a28-938e-16283ca2e329', '8ee74c81-eb77-4fc8-8df7-cf9ed42763a5', '61bc5cea-8377-4af9-82c1-87f334c6499c', '1121346f-4dab-43ea-abb9-63269363d369'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:01 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Delete snapshot completed successfully.
Jul 03 23:58:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-33d0cd90-d4d9-46c8-9fb5-2436408af970-delete_snapshot" released by "delete_snapshot" :: held 7.132s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-458fdb3a-a61b-4225-8faf-3e2c85497c48-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-458fdb3a-a61b-4225-8faf-3e2c85497c48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-quobyte-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-quobyte-458fdb3a-a61b-4225-8faf-3e2c85497c48" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-458fdb3a-a61b-4225-8faf-3e2c85497c48" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Deleting offline snapshot 458fdb3a-a61b-4225-8faf-3e2c85497c48 of volume 8624b1d8-e67f-4a55-8184-5ec3ba72fba8 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:58:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] snapshot_file for this snap is: volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:58:02 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95f654b-271b-48bf-bb12-8b7eb0c8a200]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:02 devstack sudo[96438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48
Jul 03 23:58:02 devstack sudo[96438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:02 devstack sudo[96438]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48" returned: 0 in 0.897s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:58:02 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ff4439-3745-4acd-b5bc-9a417c59f733]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:03 devstack sudo[96446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8
Jul 03 23:58:03 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:03 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" returned: 0 in 0.853s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:03 devstack sudo[96451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48
Jul 03 23:58:03 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:04 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48" returned: 0 in 0.786s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:04 devstack sudo[96456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48
Jul 03 23:58:04 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:05 devstack sudo[96458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:58:05 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:05 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8.458fdb3a-a61b-4225-8faf-3e2c85497c48" returned: 0 in 0.729s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-458fdb3a-a61b-4225-8faf-3e2c85497c48" released by "_delete_snapshot" :: held 3.372s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" released by "delete_snapshot" :: held 3.399s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Created reservations ['978a22fd-ecc7-4553-97fa-f70743be6ff4', '2dc99d4a-e253-4e7a-97dc-80ff52e16933', '5e35f43a-68d8-4025-9cea-d92119c25d37', '6b3777db-5e97-4c41-93a7-d8bf79a7c34a'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:05 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Delete snapshot completed successfully.
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-458fdb3a-a61b-4225-8faf-3e2c85497c48-delete_snapshot" released by "delete_snapshot" :: held 3.582s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Snapshots deleted, issuing volume delete {{(pid=86648) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-quobyte-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" acquired by "delete_volume" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[154ee583-6650-4099-9ada-990c7616dbaf]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:05 devstack sudo[96463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8
Jul 03 23:58:05 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:05 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.830s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:58:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:58:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" returned: 0 in 0.858s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:06 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:06 devstack sudo[96469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8
Jul 03 23:58:06 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:07 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" returned: 0 in 0.714s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-8624b1d8-e67f-4a55-8184-5ec3ba72fba8" released by "delete_volume" :: held 1.655s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Acquiring lock "cinder-60f85a43-44d4-44d6-a93e-f36507a1eab6-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Lock "cinder-60f85a43-44d4-44d6-a93e-f36507a1eab6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Created reservations ['2a924352-5d30-42d8-aa96-cd46d5ca7ea4', '198ef5e5-c6ef-4473-b770-6087b377e771', '6b82028c-699d-42c7-ae52-9986e7f12218', 'f179b26e-f49e-4e24-85d1-cc07a778ec26'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Acquiring lock "cinder-quobyte-60f85a43-44d4-44d6-a93e-f36507a1eab6" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Lock "cinder-quobyte-60f85a43-44d4-44d6-a93e-f36507a1eab6" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0f3399-523d-4c56-8c1a-cdd9e6f8a4e1]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60f85a43-44d4-44d6-a93e-f36507a1eab6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:07 devstack sudo[96473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:58:07 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:07 devstack sudo[96472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60f85a43-44d4-44d6-a93e-f36507a1eab6
Jul 03 23:58:07 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:08 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.828s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:08 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Deleted volume successfully.
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9f684ec-4382-492f-8ae6-f682e243b40e tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-8624b1d8-e67f-4a55-8184-5ec3ba72fba8-delete_volume" released by "delete_volume" :: held 13.601s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:08 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60f85a43-44d4-44d6-a93e-f36507a1eab6" returned: 0 in 1.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60f85a43-44d4-44d6-a93e-f36507a1eab6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:08 devstack sudo[96480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60f85a43-44d4-44d6-a93e-f36507a1eab6
Jul 03 23:58:08 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Flow 'volume_create_manager' (3a5c2e87-948c-41f0-9ee8-c9218000556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a1d04b-05ef-408f-9181-a465ac78f6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88a1d04b-05ef-408f-9181-a465ac78f6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-666459490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e516c87f-381c-4ce1-b7d3-72c8a3f89742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd1437fb8784e1e85403766bac9519d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:08Z,use_quota=True,user_id='59a1daa617b6422cb9d182b861833342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b3a841-f429-428c-9045-d50f2c79dc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b3a841-f429-428c-9045-d50f2c79dc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde8f604-6f29-4238-9659-ce1b8fca40cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde8f604-6f29-4238-9659-ce1b8fca40cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e516c87f-381c-4ce1-b7d3-72c8a3f89742', 'volume_name': 'volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a910bb-9597-4599-ba99-46de4ce8cb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a910bb-9597-4599-ba99-46de4ce8cb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296d5a90-21c9-4834-894c-cc5e98229bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:08 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Volume e516c87f-381c-4ce1-b7d3-72c8a3f89742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742', 'volume_size': 1}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-666459490',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e516c87f-381c-4ce1-b7d3-72c8a3f89742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd1437fb8784e1e85403766bac9519d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:08Z,use_quota=True,user_id='59a1daa617b6422cb9d182b861833342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Creating volume e516c87f-381c-4ce1-b7d3-72c8a3f89742 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:58:08 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:08 devstack sudo[96482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742 1073741824
Jul 03 23:58:08 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Flow 'volume_create_manager' (8630fbf0-39a6-4bf8-bb35-ec6f01e1b99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2aa8f6-ade8-4fcc-8e4a-20f5d0795ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a2aa8f6-ade8-4fcc-8e4a-20f5d0795ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1838342441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c46f92e-37a2-4c0e-8609-c76e2355aff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25688b7c87e4f32906b06d0adc59565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:09Z,use_quota=True,user_id='8d0818cf44c7419f85ae63ece1f32fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df751b24-a740-4a1f-9a31-5b028a31e7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df751b24-a740-4a1f-9a31-5b028a31e7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94509773-8ea6-4ff3-a615-83156bea59d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94509773-8ea6-4ff3-a615-83156bea59d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c46f92e-37a2-4c0e-8609-c76e2355aff8', 'volume_name': 'volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e61e16-1216-4160-ac57-03401a64830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e61e16-1216-4160-ac57-03401a64830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8236a586-1a0e-4fd4-91cb-996b06e1a602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:08 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Volume 8c46f92e-37a2-4c0e-8609-c76e2355aff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8', 'volume_size': 1}
Jul 03 23:58:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:09 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60f85a43-44d4-44d6-a93e-f36507a1eab6" returned: 0 in 0.731s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Lock "cinder-quobyte-60f85a43-44d4-44d6-a93e-f36507a1eab6" released by "delete_volume" :: held 1.790s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Created reservations ['c32a4af0-341b-4bb9-a49f-0a3d1281fe6d', '0a74f24c-603d-4b22-a092-d400176f6383', 'e9562d82-cefe-4d7a-b79c-8d6836ce43e5', '177e4dee-4b3f-462f-8676-ffe606fe24b1'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:09 devstack sudo[96524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:58:09 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:09 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742 1073741824" returned: 0 in 0.919s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:09 devstack sudo[96527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742
Jul 03 23:58:09 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:09 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.692s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Deleted volume successfully.
Jul 03 23:58:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1e85ebec-137f-401a-a927-24bc6c0be2cf tempest-AttachVolumeShelveTestJSON-1127144584 None] Lock "cinder-60f85a43-44d4-44d6-a93e-f36507a1eab6-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:10 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742" returned: 0 in 0.649s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.464s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1838342441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c46f92e-37a2-4c0e-8609-c76e2355aff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25688b7c87e4f32906b06d0adc59565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:09Z,use_quota=True,user_id='8d0818cf44c7419f85ae63ece1f32fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Creating volume 8c46f92e-37a2-4c0e-8609-c76e2355aff8 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:58:10 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296d5a90-21c9-4834-894c-cc5e98229bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:10 devstack sudo[96531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 1073741824
Jul 03 23:58:10 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b924d58-6a4a-453a-a3e4-92fc94ba4acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:10 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Volume volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742 (e516c87f-381c-4ce1-b7d3-72c8a3f89742): created successfully
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b924d58-6a4a-453a-a3e4-92fc94ba4acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Flow 'volume_create_manager' (3a5c2e87-948c-41f0-9ee8-c9218000556b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:10 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1126a8cd-a554-49b3-91d9-92deec6b1502 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Created volume successfully.
Jul 03 23:58:11 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 1073741824" returned: 0 in 0.990s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:11 devstack sudo[96538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8
Jul 03 23:58:11 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Acquiring lock "cinder-e516c87f-381c-4ce1-b7d3-72c8a3f89742-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Lock "cinder-e516c87f-381c-4ce1-b7d3-72c8a3f89742-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Acquiring lock "cinder-quobyte-e516c87f-381c-4ce1-b7d3-72c8a3f89742" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Lock "cinder-quobyte-e516c87f-381c-4ce1-b7d3-72c8a3f89742" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:11 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08f7fb4-3bb5-415e-b496-7b1ce1b79e3d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:11 devstack sudo[96540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742
Jul 03 23:58:11 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:11 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8" returned: 0 in 0.704s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:58:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8236a586-1a0e-4fd4-91cb-996b06e1a602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33a4535-f8f4-4fe9-8355-6be09fb6608f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:12 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Volume volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 (8c46f92e-37a2-4c0e-8609-c76e2355aff8): created successfully
Jul 03 23:58:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33a4535-f8f4-4fe9-8355-6be09fb6608f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Flow 'volume_create_manager' (8630fbf0-39a6-4bf8-bb35-ec6f01e1b99d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-11b41cf8-4d2c-47a0-b797-4db797823afa tempest-VolumesDeleteCascade-69068788 None] Created volume successfully.
Jul 03 23:58:12 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742" returned: 0 in 0.876s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:12 devstack sudo[96546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742
Jul 03 23:58:12 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=104,cinder:SELECT=75,cinder:INSERT=22,cinder:DELETE=8 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] Creating offline snapshot 52bee0bc-3384-4968-9a13-0b833d288446 of volume 8c46f92e-37a2-4c0e-8609-c76e2355aff8 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e017c1b-7a6f-4e37-a359-3d684a9114c2]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:13 devstack sudo[96548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8
Jul 03 23:58:13 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:13 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e516c87f-381c-4ce1-b7d3-72c8a3f89742" returned: 0 in 0.733s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Lock "cinder-quobyte-e516c87f-381c-4ce1-b7d3-72c8a3f89742" released by "delete_volume" :: held 1.674s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Created reservations ['c2b3804d-05f1-4243-abcb-f6d968e0255c', '6b6bd698-4a6c-4479-9404-ca3ee8ef1960', '896f6817-c9fd-423a-8a94-0f07fda4e09b', '86fc615d-4985-46a8-8986-575623d6ca99'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:13 devstack sudo[96552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:58:13 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:14 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8" returned: 0 in 1.024s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:14 devstack sudo[96558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446 1G
Jul 03 23:58:14 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:14 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.834s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:14 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:14 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Deleted volume successfully.
Jul 03 23:58:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d4f3bc48-856d-4697-8bbb-5c836ac49fa7 tempest-VolumeQuotasNegativeTestJSON-1459579543 None] Lock "cinder-e516c87f-381c-4ce1-b7d3-72c8a3f89742-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:15 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446 1G" returned: 0 in 0.964s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:15 devstack sudo[96566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446
Jul 03 23:58:15 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:15 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446" returned: 0 in 0.809s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:15 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446 is being set with open permissions: ugo+rw
Jul 03 23:58:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:15 devstack sudo[96571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446
Jul 03 23:58:15 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:16 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446" returned: 0 in 0.716s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:16 devstack sudo[96574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.info
Jul 03 23:58:16 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:17 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.info" returned: 0 in 0.711s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:17 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.info is being set with open permissions: ugo+rw
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:17 devstack sudo[96577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.info
Jul 03 23:58:17 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Flow 'volume_create_manager' (5c925648-5c6e-4910-b550-a628628d3391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0738eda-0f7d-40c4-9d99-e3f681ca246d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0738eda-0f7d-40c4-9d99-e3f681ca246d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-606860049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fad868-6cba-439d-b317-44d3cf1674f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b824afe78c942d692f5e1819c498005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:18Z,use_quota=True,user_id='b537166e88ab4b998a20baa9d37a9b7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745f8307-55f4-4d5c-a08c-7663a4c44ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745f8307-55f4-4d5c-a08c-7663a4c44ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7defa41a-1219-4ea9-a790-b32f0fbbbdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7defa41a-1219-4ea9-a790-b32f0fbbbdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13fad868-6cba-439d-b317-44d3cf1674f4', 'volume_name': 'volume-13fad868-6cba-439d-b317-44d3cf1674f4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e256b92-30fc-4fcb-8482-a9be354482c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e256b92-30fc-4fcb-8482-a9be354482c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02be629-2062-49b0-ac79-6fa6d8ff054c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:17 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Volume 13fad868-6cba-439d-b317-44d3cf1674f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13fad868-6cba-439d-b317-44d3cf1674f4', 'volume_size': 1}
Jul 03 23:58:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:18 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.info" returned: 0 in 0.669s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.022s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.213s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-606860049',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fad868-6cba-439d-b317-44d3cf1674f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b824afe78c942d692f5e1819c498005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:18Z,use_quota=True,user_id='b537166e88ab4b998a20baa9d37a9b7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Creating volume 13fad868-6cba-439d-b317-44d3cf1674f4 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:58:18 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:18 devstack sudo[96580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4 1073741824
Jul 03 23:58:18 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:18 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4b80f44f-4f92-4cb8-a1e3-eab61082abfb tempest-VolumesDeleteCascade-69068788 None] Create snapshot completed successfully
Jul 03 23:58:18 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Flow 'volume_create_manager' (778c5e65-1c2c-4a42-994f-6cd4527929f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262baa5c-a50c-4a20-be54-ea3587017ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (262baa5c-a50c-4a20-be54-ea3587017ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-596291230',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992a1ad2-de1a-43b9-ac7d-90ba4673de21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25688b7c87e4f32906b06d0adc59565',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52bee0bc-3384-4968-9a13-0b833d288446,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:19Z,use_quota=True,user_id='8d0818cf44c7419f85ae63ece1f32fb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521d94d0-4a1a-41fd-adfa-c6f4e45f9810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (521d94d0-4a1a-41fd-adfa-c6f4e45f9810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bff1a0-ff9a-4d96-ac3a-831c05cbd9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18bff1a0-ff9a-4d96-ac3a-831c05cbd9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '992a1ad2-de1a-43b9-ac7d-90ba4673de21', 'volume_name': 'volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21', 'volume_size': 1, 'snapshot_id': '52bee0bc-3384-4968-9a13-0b833d288446'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e813d8a-2d18-42c3-8eae-78eb3fa70135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e813d8a-2d18-42c3-8eae-78eb3fa70135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b15d3a-d649-4425-8cd9-0f3f98abd49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:19 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Volume 992a1ad2-de1a-43b9-ac7d-90ba4673de21: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21', 'volume_size': 1, 'snapshot_id': '52bee0bc-3384-4968-9a13-0b833d288446'}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:19 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4 1073741824" returned: 0 in 0.967s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:19 devstack sudo[96586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4
Jul 03 23:58:19 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:19 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4" returned: 0 in 0.676s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.731s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-quobyte-52bee0bc-3384-4968-9a13-0b833d288446-992a1ad2-de1a-43b9-ac7d-90ba4673de21" by "_create_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b02be629-2062-49b0-ac79-6fa6d8ff054c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fad868-6cba-439d-b317-44d3cf1674f4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c7bcca-ec51-4847-87ad-c4c96ff64337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-52bee0bc-3384-4968-9a13-0b833d288446-992a1ad2-de1a-43b9-ac7d-90ba4673de21" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Creating volume 992a1ad2-de1a-43b9-ac7d-90ba4673de21 from snapshot 52bee0bc-3384-4968-9a13-0b833d288446 {{(pid=86648) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-quobyte-992a1ad2-de1a-43b9-ac7d-90ba4673de21" by "_copy_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:19 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Volume volume-13fad868-6cba-439d-b317-44d3cf1674f4 (13fad868-6cba-439d-b317-44d3cf1674f4): created successfully
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47c7bcca-ec51-4847-87ad-c4c96ff64337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Flow 'volume_create_manager' (5c925648-5c6e-4910-b550-a628628d3391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-992a1ad2-de1a-43b9-ac7d-90ba4673de21" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] snapshot: 52bee0bc-3384-4968-9a13-0b833d288446, volume: 992a1ad2-de1a-43b9-ac7d-90ba4673de21,  {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 23:58:19 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-94737fa0-45e9-49b6-96c1-39804c2f3292 req-6e7587d9-1f70-4426-837d-88f83bf21593 tempest-VolumesSnapshotsTestJSON-1998349959 None] Created volume successfully.
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f091b8-6907-4b8e-b131-57b66f60cb49]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:20 devstack sudo[96589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446
Jul 03 23:58:20 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Flow 'volume_create_manager' (6a61b195-9df7-4215-9e2e-f8f39fe4ff29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a6917e-ec3b-4ef5-8471-71f5662213ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a6917e-ec3b-4ef5-8471-71f5662213ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1393611767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca3233a1-7889-4409-a012-d9711a1eb1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b083475e6f49a497dc178666f1909f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:20Z,use_quota=True,user_id='be3ccc0f4b104bcd97e6de1639376e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0cd8c47-0dab-4874-b08d-a4ad3afb1301),volume_type_id=a0cd8c47-0dab-4874-b08d-a4ad3afb1301)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8396170d-676b-4c70-9dd6-494cfc7b2210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8396170d-676b-4c70-9dd6-494cfc7b2210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63df556-53bb-4f9a-9876-c9067f922546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63df556-53bb-4f9a-9876-c9067f922546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca3233a1-7889-4409-a012-d9711a1eb1cc', 'volume_name': 'volume-ca3233a1-7889-4409-a012-d9711a1eb1cc', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579732ab-67d1-4a62-8e57-0fa67df6f998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579732ab-67d1-4a62-8e57-0fa67df6f998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a416b3bd-877d-49c3-8b5f-93287d369dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:20 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Volume ca3233a1-7889-4409-a012-d9711a1eb1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca3233a1-7889-4409-a012-d9711a1eb1cc', 'volume_size': 1}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:20 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446" returned: 0 in 0.794s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] will copy from snapshot at /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Creating direct copy from snapshot {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9062e08-7f13-478a-a5b5-3907c6bbb85f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:20 devstack sudo[96595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8
Jul 03 23:58:20 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:21 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8" returned: 0 in 0.740s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:21 devstack cinder-volume[86648]: DEBUG cinder.utils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Path /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21 not found in is_blk_device check {{(pid=86648) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 23:58:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:21 devstack sudo[96600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21
Jul 03 23:58:21 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:26 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21" returned: 0 in 4.534s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:26 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5b3460-287d-4c59-a6c5-fb7b2c8b2d88]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:26 devstack sudo[96619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8
Jul 03 23:58:26 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:26 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8" returned: 0 in 0.874s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:26 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:58:26 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Converted 1024.00 MB image at 225.78 MB/s
Jul 03 23:58:26 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21 is being set with open permissions: ugo+rw
Jul 03 23:58:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:26 devstack sudo[96624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21
Jul 03 23:58:26 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:27 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21" returned: 0 in 0.621s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-992a1ad2-de1a-43b9-ac7d-90ba4673de21" released by "_copy_volume_from_snapshot" :: held 7.686s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-52bee0bc-3384-4968-9a13-0b833d288446-992a1ad2-de1a-43b9-ac7d-90ba4673de21" released by "_create_volume_from_snapshot" :: held 7.738s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.779s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.197s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=94,cinder:SELECT=87,cinder:INSERT=24,cinder:DELETE=7 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] Creating offline snapshot 0b7b635c-78b9-4e49-8eb7-83cdf8602d07 of volume 13fad868-6cba-439d-b317-44d3cf1674f4 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b15d3a-d649-4425-8cd9-0f3f98abd49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21', 'volume_size': 1, 'snapshot_id': '52bee0bc-3384-4968-9a13-0b833d288446'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51c9adb-6015-409b-b81e-847c62b14a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc28b7e-728a-4ae7-97de-55e1ddd00905]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:27 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Volume volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21 (992a1ad2-de1a-43b9-ac7d-90ba4673de21): created successfully
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51c9adb-6015-409b-b81e-847c62b14a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Flow 'volume_create_manager' (778c5e65-1c2c-4a42-994f-6cd4527929f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e046f669-31ec-4d80-9bb2-b980377b2bea tempest-VolumesDeleteCascade-69068788 None] Created volume successfully.
Jul 03 23:58:27 devstack sudo[96627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4
Jul 03 23:58:27 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:28 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4" returned: 0 in 0.734s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:28 devstack sudo[96632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07 1G
Jul 03 23:58:28 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-8c46f92e-37a2-4c0e-8609-c76e2355aff8-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-8c46f92e-37a2-4c0e-8609-c76e2355aff8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Performing cascade delete. {{(pid=86648) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-52bee0bc-3384-4968-9a13-0b833d288446-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-52bee0bc-3384-4968-9a13-0b833d288446-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-quobyte-8c46f92e-37a2-4c0e-8609-c76e2355aff8" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-8c46f92e-37a2-4c0e-8609-c76e2355aff8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-quobyte-52bee0bc-3384-4968-9a13-0b833d288446" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-52bee0bc-3384-4968-9a13-0b833d288446" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Deleting offline snapshot 52bee0bc-3384-4968-9a13-0b833d288446 of volume 8c46f92e-37a2-4c0e-8609-c76e2355aff8 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] snapshot_file for this snap is: volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db2c3bf-e86d-45ee-bd7f-c100d40f08ca]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:29 devstack sudo[96636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446
Jul 03 23:58:29 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:29 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07 1G" returned: 0 in 0.838s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13fad868-6cba-439d-b317-44d3cf1674f4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:29 devstack sudo[96642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13fad868-6cba-439d-b317-44d3cf1674f4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07
Jul 03 23:58:29 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:29 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446" returned: 0 in 0.754s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:58:29 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4501cdf3-f266-4ad7-9a4d-faee1c274260]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:29 devstack sudo[96647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8
Jul 03 23:58:29 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:29 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13fad868-6cba-439d-b317-44d3cf1674f4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07" returned: 0 in 0.711s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:29 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07 is being set with open permissions: ugo+rw
Jul 03 23:58:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:29 devstack sudo[96652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07
Jul 03 23:58:29 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:30 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8" returned: 0 in 0.784s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:30 devstack sudo[96658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446
Jul 03 23:58:30 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:30 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07" returned: 0 in 0.678s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:30 devstack sudo[96661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.info
Jul 03 23:58:30 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:31 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446" returned: 0 in 0.792s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:31 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446
Jul 03 23:58:31 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:31 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.info" returned: 0 in 0.656s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:31 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.info is being set with open permissions: ugo+rw
Jul 03 23:58:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:31 devstack sudo[96669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.info
Jul 03 23:58:31 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:31 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8.52bee0bc-3384-4968-9a13-0b833d288446" returned: 0 in 0.680s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-52bee0bc-3384-4968-9a13-0b833d288446" released by "_delete_snapshot" :: held 3.121s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:31 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.info" returned: 0 in 0.667s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.416s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-8c46f92e-37a2-4c0e-8609-c76e2355aff8" released by "delete_snapshot" :: held 3.162s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.529s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1393611767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca3233a1-7889-4409-a012-d9711a1eb1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32b083475e6f49a497dc178666f1909f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:20Z,use_quota=True,user_id='be3ccc0f4b104bcd97e6de1639376e04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0cd8c47-0dab-4874-b08d-a4ad3afb1301),volume_type_id=a0cd8c47-0dab-4874-b08d-a4ad3afb1301)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Creating volume ca3233a1-7889-4409-a012-d9711a1eb1cc {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:58:32 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ca3233a1-7889-4409-a012-d9711a1eb1cc 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:32 devstack sudo[96673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ca3233a1-7889-4409-a012-d9711a1eb1cc 1073741824
Jul 03 23:58:32 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-9b92cb20-4adb-4b47-aa0c-80a858f23e11 req-1cc23f6a-e63e-49aa-b9b3-bcc2a0b22100 tempest-VolumesSnapshotsTestJSON-1998349959 None] Create snapshot completed successfully
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Created reservations ['32d69ba0-718c-49ee-8f5c-ca302c6b03bf', '355814a0-5b62-4ec9-8272-c38116e33c24', '997c8394-b6ba-4622-8e5b-cd6235495738', 'd02f8e24-4432-482f-bb2e-68cccbcea73e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Delete snapshot completed successfully.
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-52bee0bc-3384-4968-9a13-0b833d288446-delete_snapshot" released by "delete_snapshot" :: held 3.410s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Snapshots deleted, issuing volume delete {{(pid=86648) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-quobyte-8c46f92e-37a2-4c0e-8609-c76e2355aff8" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-8c46f92e-37a2-4c0e-8609-c76e2355aff8" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[489a8388-d663-4914-a333-fdb1a03b5067]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:32 devstack sudo[96675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8
Jul 03 23:58:32 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Acquiring lock "cinder-0b7b635c-78b9-4e49-8eb7-83cdf8602d07-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "cinder-0b7b635c-78b9-4e49-8eb7-83cdf8602d07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Acquiring lock "cinder-quobyte-13fad868-6cba-439d-b317-44d3cf1674f4" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "cinder-quobyte-13fad868-6cba-439d-b317-44d3cf1674f4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Acquiring lock "cinder-quobyte-0b7b635c-78b9-4e49-8eb7-83cdf8602d07" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "cinder-quobyte-0b7b635c-78b9-4e49-8eb7-83cdf8602d07" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Deleting offline snapshot 0b7b635c-78b9-4e49-8eb7-83cdf8602d07 of volume 13fad868-6cba-439d-b317-44d3cf1674f4 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] snapshot_file for this snap is: volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e312beab-7d7d-4e61-8928-82c9fba5921f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:32 devstack sudo[96679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07
Jul 03 23:58:32 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:32 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ca3233a1-7889-4409-a012-d9711a1eb1cc 1073741824" returned: 0 in 0.895s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ca3233a1-7889-4409-a012-d9711a1eb1cc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:32 devstack sudo[96683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ca3233a1-7889-4409-a012-d9711a1eb1cc
Jul 03 23:58:32 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:33 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8" returned: 0 in 0.868s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:33 devstack sudo[96688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8
Jul 03 23:58:33 devstack sudo[96688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:33 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07" returned: 0 in 0.821s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13fad868-6cba-439d-b317-44d3cf1674f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a23274-9b64-41a4-a5b8-952c03014a05]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:33 devstack sudo[96693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4
Jul 03 23:58:33 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:33 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ca3233a1-7889-4409-a012-d9711a1eb1cc" returned: 0 in 0.664s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a416b3bd-877d-49c3-8b5f-93287d369dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca3233a1-7889-4409-a012-d9711a1eb1cc', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f3c8c5-110d-4118-88c0-ed45a84808cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:33 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Volume volume-ca3233a1-7889-4409-a012-d9711a1eb1cc (ca3233a1-7889-4409-a012-d9711a1eb1cc): created successfully
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f3c8c5-110d-4118-88c0-ed45a84808cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Flow 'volume_create_manager' (6a61b195-9df7-4215-9e2e-f8f39fe4ff29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:33 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5bba6e53-31ff-4632-bbb5-c824c43f5c29 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Created volume successfully.
Jul 03 23:58:33 devstack sudo[96688]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8c46f92e-37a2-4c0e-8609-c76e2355aff8" returned: 0 in 0.738s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-8c46f92e-37a2-4c0e-8609-c76e2355aff8" released by "delete_volume" :: held 1.674s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:33 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Created reservations ['aedc23de-26f5-40a2-916b-ce28b0cde8f8', '7cd61e36-9fc1-491b-95b8-a3d16502f840', '713f9a51-2dce-43aa-8021-8d2b3c719f25', 'bbe76717-b5a5-46a8-9798-1655cd79f423'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:34 devstack sudo[96697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:58:34 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:34 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4" returned: 0 in 0.813s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-992a1ad2-de1a-43b9-ac7d-90ba4673de21-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:34 devstack sudo[96702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07
Jul 03 23:58:34 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-992a1ad2-de1a-43b9-ac7d-90ba4673de21-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "cinder-quobyte-992a1ad2-de1a-43b9-ac7d-90ba4673de21" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-992a1ad2-de1a-43b9-ac7d-90ba4673de21" acquired by "delete_volume" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6c7d59-9b29-4336-8198-1a840908b4e6]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:34 devstack sudo[96704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21
Jul 03 23:58:34 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:34 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.846s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Deleted volume successfully.
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c3c47d2d-2dfb-4d62-8abd-88dcbde252b0 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-8c46f92e-37a2-4c0e-8609-c76e2355aff8-delete_volume" released by "delete_volume" :: held 6.204s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5c320229-c8cd-4750-9aa9-7321ec2da050 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5c320229-c8cd-4750-9aa9-7321ec2da050 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5c320229-c8cd-4750-9aa9-7321ec2da050 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5c320229-c8cd-4750-9aa9-7321ec2da050 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5c320229-c8cd-4750-9aa9-7321ec2da050 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5c320229-c8cd-4750-9aa9-7321ec2da050 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:35 devstack sudo[96711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:58:35 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:35 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07" returned: 0 in 0.882s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:35 devstack sudo[96713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07
Jul 03 23:58:35 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:35 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21" returned: 0 in 0.938s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:35 devstack sudo[96718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21
Jul 03 23:58:35 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:35 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5c320229-c8cd-4750-9aa9-7321ec2da050 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.707s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:35 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-5c320229-c8cd-4750-9aa9-7321ec2da050 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:35 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5c320229-c8cd-4750-9aa9-7321ec2da050 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Retype volume completed successfully.
Jul 03 23:58:35 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4.0b7b635c-78b9-4e49-8eb7-83cdf8602d07" returned: 0 in 0.690s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "cinder-quobyte-0b7b635c-78b9-4e49-8eb7-83cdf8602d07" released by "_delete_snapshot" :: held 3.329s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "cinder-quobyte-13fad868-6cba-439d-b317-44d3cf1674f4" released by "delete_snapshot" :: held 3.370s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:35 devstack cinder-volume[86648]: DEBUG cinder.quota [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Created reservations ['df62e6ed-0adc-47ba-b676-e7661fa977e7', '81f91c04-e519-4b1a-8184-d4e68a1e4a92', '23f6087e-d076-4080-9705-bc4c139f31f3', '074c767f-05b3-48cc-a6ae-dc49c120114f'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:36 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Delete snapshot completed successfully.
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-ed5acd8f-e4c1-44c2-b09c-6e87693f8431 req-f70fb68e-c0ea-4bf3-a9c8-004eb64f6b8d tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "cinder-0b7b635c-78b9-4e49-8eb7-83cdf8602d07-delete_snapshot" released by "delete_snapshot" :: held 3.525s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:36 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-992a1ad2-de1a-43b9-ac7d-90ba4673de21" returned: 0 in 0.693s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-quobyte-992a1ad2-de1a-43b9-ac7d-90ba4673de21" released by "delete_volume" :: held 1.698s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Created reservations ['f712161a-434e-4617-8fa9-a5b4b13bbdc8', '74a4ed56-d1c7-459a-b234-65cde2b54c26', '5e8a8320-dbf9-43b0-a7e2-913616ee7398', '3dfee785-eec4-469d-be96-a07d09c6336d'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Acquiring lock "cinder-ca3233a1-7889-4409-a012-d9711a1eb1cc-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Lock "cinder-ca3233a1-7889-4409-a012-d9711a1eb1cc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:36 devstack sudo[96723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:58:36 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Acquiring lock "cinder-quobyte-ca3233a1-7889-4409-a012-d9711a1eb1cc" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Lock "cinder-quobyte-ca3233a1-7889-4409-a012-d9711a1eb1cc" acquired by "delete_volume" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1832c8-0db7-4685-9a85-5bf8a853873c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ca3233a1-7889-4409-a012-d9711a1eb1cc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:36 devstack sudo[96725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ca3233a1-7889-4409-a012-d9711a1eb1cc
Jul 03 23:58:36 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Acquiring lock "cinder-13fad868-6cba-439d-b317-44d3cf1674f4-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:36 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.705s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "cinder-13fad868-6cba-439d-b317-44d3cf1674f4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:36 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Deleted volume successfully.
Jul 03 23:58:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2b724ead-c6ef-4856-8012-865b70ba9247 tempest-VolumesDeleteCascade-69068788 None] Lock "cinder-992a1ad2-de1a-43b9-ac7d-90ba4673de21-delete_volume" released by "delete_volume" :: held 2.697s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Acquiring lock "cinder-quobyte-13fad868-6cba-439d-b317-44d3cf1674f4" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "cinder-quobyte-13fad868-6cba-439d-b317-44d3cf1674f4" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:37 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dca7acb-4baa-4483-a512-739e2021a7c2]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:37 devstack sudo[96728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4
Jul 03 23:58:37 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:37 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ca3233a1-7889-4409-a012-d9711a1eb1cc" returned: 0 in 0.960s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ca3233a1-7889-4409-a012-d9711a1eb1cc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:37 devstack sudo[96733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ca3233a1-7889-4409-a012-d9711a1eb1cc
Jul 03 23:58:37 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:37 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4" returned: 0 in 0.869s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:38 devstack sudo[96739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4
Jul 03 23:58:38 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:38 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ca3233a1-7889-4409-a012-d9711a1eb1cc" returned: 0 in 0.726s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Lock "cinder-quobyte-ca3233a1-7889-4409-a012-d9711a1eb1cc" released by "delete_volume" :: held 1.736s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:38 devstack cinder-volume[86648]: WARNING cinder.quota [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:58:38 devstack cinder-volume[86648]: WARNING cinder.quota [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:58:38 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Created reservations ['0a8cb198-f241-4925-80c8-2bfc4e69b569', 'e030b623-a5f1-4c1b-8a95-ce60603d152a', 'fc180022-8075-431b-a908-05b56478d638', '1881e955-6938-451c-a2ee-3d28a9567926'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:38 devstack sudo[96741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:58:38 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:38 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-13fad868-6cba-439d-b317-44d3cf1674f4" returned: 0 in 0.857s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "cinder-quobyte-13fad868-6cba-439d-b317-44d3cf1674f4" released by "delete_volume" :: held 1.810s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:38 devstack cinder-volume[86648]: DEBUG cinder.quota [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Created reservations ['89247979-f578-4c7f-929b-642056463162', '1d45c289-7e79-4990-853d-8df409a369dc', '47183490-1d80-4f78-b400-fc325e9b11b7', 'e4f7ade4-ddae-4301-ac19-da6d1886d628'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:39 devstack sudo[96744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:58:39 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:39 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.851s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:39 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Deleted volume successfully.
Jul 03 23:58:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ed4c2aee-8f77-4497-b201-a0b1e6f1da67 tempest-VolumeRetypeWithoutMigrationTest-2014296488 None] Lock "cinder-ca3233a1-7889-4409-a012-d9711a1eb1cc-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:39 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.765s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:39 devstack cinder-volume[86648]: DEBUG cinder.manager [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Deleted volume successfully.
Jul 03 23:58:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-7419f7c9-eed3-4046-aab1-fbac7f13cb9b req-a9fa74e6-fb0c-41a7-818a-896824974f86 tempest-VolumesSnapshotsTestJSON-1998349959 None] Lock "cinder-13fad868-6cba-439d-b317-44d3cf1674f4-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-54b83bde-ad90-4aaa-835d-ff9a23a3c474 tempest-BackendsCapabilitiesAdminTestsJSON-1786459523 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86648) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 23:58:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-44b31cc3-093d-4865-9482-3e04be658702 tempest-BackendsCapabilitiesAdminTestsJSON-1786459523 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86648) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 23:58:49 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=51,cinder:INSERT=18,cinder:UPDATE=70,cinder:DELETE=8 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:58:49 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=47,cinder:SELECT=43,cinder:INSERT=12,cinder:DELETE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Flow 'volume_create_manager' (10af8352-0028-48f6-a33f-5ce8d519af82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6934895-9ffb-4a50-ae2a-ca359333d0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6934895-9ffb-4a50-ae2a-ca359333d0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1441676527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7c006a-a5ac-441b-b381-1c9c5b841318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8abdc19dd74050a437436b98a9a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:52Z,use_quota=True,user_id='bfd4f0fd5bde4e7a8356707769f9d8e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ba8250-06d1-4597-8b73-b8d7bce8fe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ba8250-06d1-4597-8b73-b8d7bce8fe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df386561-417a-4d1f-83c4-2ecea0d901e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df386561-417a-4d1f-83c4-2ecea0d901e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da7c006a-a5ac-441b-b381-1c9c5b841318', 'volume_name': 'volume-da7c006a-a5ac-441b-b381-1c9c5b841318', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de8ec80-ca2a-4b46-b55d-3900d24e812f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de8ec80-ca2a-4b46-b55d-3900d24e812f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76621ad-fda9-40dc-ae0a-126417df2f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:51 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Volume da7c006a-a5ac-441b-b381-1c9c5b841318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da7c006a-a5ac-441b-b381-1c9c5b841318', 'volume_size': 1}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1441676527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da7c006a-a5ac-441b-b381-1c9c5b841318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8abdc19dd74050a437436b98a9a24f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:52Z,use_quota=True,user_id='bfd4f0fd5bde4e7a8356707769f9d8e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Creating volume da7c006a-a5ac-441b-b381-1c9c5b841318 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:58:51 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:58:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:51 devstack sudo[96752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 1073741824
Jul 03 23:58:51 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:53 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 1073741824" returned: 0 in 1.133s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:53 devstack sudo[96758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318
Jul 03 23:58:53 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:53 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318" returned: 0 in 0.689s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:58:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76621ad-fda9-40dc-ae0a-126417df2f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da7c006a-a5ac-441b-b381-1c9c5b841318', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f13bf5-aaaa-4fb1-a863-b690632e4f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:53 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Volume volume-da7c006a-a5ac-441b-b381-1c9c5b841318 (da7c006a-a5ac-441b-b381-1c9c5b841318): created successfully
Jul 03 23:58:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f13bf5-aaaa-4fb1-a863-b690632e4f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Flow 'volume_create_manager' (10af8352-0028-48f6-a33f-5ce8d519af82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:53 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-de61fa58-dee6-44b8-b2c7-8abef262bbf2 tempest-VolumesActionsTest-2078845086 None] Created volume successfully.
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Flow 'volume_create_manager' (e0701d59-375b-49d6-b068-764fd771d8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acfac326-8a18-4472-8ebb-647ffe43ccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acfac326-8a18-4472-8ebb-647ffe43ccdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1673948213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15d6620-158d-4269-a481-a9c09eefd9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e506daac3304779ada6677474cfcc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:02Z,use_quota=True,user_id='84dd2edfa01e4d2284b8a18cb7f55df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74503fd-1167-4ba9-b1f6-d4af14725523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74503fd-1167-4ba9-b1f6-d4af14725523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744d8d3d-9cb0-4a34-8ceb-4e2b46bd5fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744d8d3d-9cb0-4a34-8ceb-4e2b46bd5fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15d6620-158d-4269-a481-a9c09eefd9d6', 'volume_name': 'volume-a15d6620-158d-4269-a481-a9c09eefd9d6', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933adc74-667b-442c-aaf8-e5b6025a7c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933adc74-667b-442c-aaf8-e5b6025a7c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba83755e-a4f9-45a4-a181-237d9e446d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:02 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Volume a15d6620-158d-4269-a481-a9c09eefd9d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15d6620-158d-4269-a481-a9c09eefd9d6', 'volume_size': 1}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1673948213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15d6620-158d-4269-a481-a9c09eefd9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e506daac3304779ada6677474cfcc66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:02Z,use_quota=True,user_id='84dd2edfa01e4d2284b8a18cb7f55df0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Creating volume a15d6620-158d-4269-a481-a9c09eefd9d6 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:02 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:59:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a15d6620-158d-4269-a481-a9c09eefd9d6 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:02 devstack sudo[96768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a15d6620-158d-4269-a481-a9c09eefd9d6 1073741824
Jul 03 23:59:02 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:03 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a15d6620-158d-4269-a481-a9c09eefd9d6 1073741824" returned: 0 in 1.125s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a15d6620-158d-4269-a481-a9c09eefd9d6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:03 devstack sudo[96776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a15d6620-158d-4269-a481-a9c09eefd9d6
Jul 03 23:59:03 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:04 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a15d6620-158d-4269-a481-a9c09eefd9d6" returned: 0 in 0.911s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:04 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] <== create_volume: return (2103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.106s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba83755e-a4f9-45a4-a181-237d9e446d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15d6620-158d-4269-a481-a9c09eefd9d6', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ed735d-f641-424a-93ee-e139ef2401dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:04 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Volume volume-a15d6620-158d-4269-a481-a9c09eefd9d6 (a15d6620-158d-4269-a481-a9c09eefd9d6): created successfully
Jul 03 23:59:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ed735d-f641-424a-93ee-e139ef2401dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Flow 'volume_create_manager' (e0701d59-375b-49d6-b068-764fd771d8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:04 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1028d429-c791-4dba-abfe-b508bbdaca10 tempest-VolumesServicesTestJSON-385764225 None] Created volume successfully.
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:05 devstack sudo[96796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:59:05 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Acquiring lock "cinder-a15d6620-158d-4269-a481-a9c09eefd9d6-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Lock "cinder-a15d6620-158d-4269-a481-a9c09eefd9d6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Acquiring lock "cinder-quobyte-a15d6620-158d-4269-a481-a9c09eefd9d6" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Lock "cinder-quobyte-a15d6620-158d-4269-a481-a9c09eefd9d6" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[698ccd3f-3642-4738-967b-c9800d262f4f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a15d6620-158d-4269-a481-a9c09eefd9d6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:05 devstack sudo[96800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a15d6620-158d-4269-a481-a9c09eefd9d6
Jul 03 23:59:05 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:05 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.851s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:59:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:59:06 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a15d6620-158d-4269-a481-a9c09eefd9d6" returned: 0 in 0.998s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a15d6620-158d-4269-a481-a9c09eefd9d6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:06 devstack sudo[96806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a15d6620-158d-4269-a481-a9c09eefd9d6
Jul 03 23:59:06 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:07 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a15d6620-158d-4269-a481-a9c09eefd9d6" returned: 0 in 0.719s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Lock "cinder-quobyte-a15d6620-158d-4269-a481-a9c09eefd9d6" released by "delete_volume" :: held 1.770s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:07 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Created reservations ['5a575432-163e-4ed4-bd3b-ab394319a8d9', '3f5bbaae-adca-4106-b9c1-e73f8dde4900', '6dbf9a86-cb4f-4a36-932f-6d333eaf832b', '65652153-cedf-4825-ac7c-8d892fa19e49'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:59:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:07 devstack sudo[96809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:59:07 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:08 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.927s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:08 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:59:08 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Deleted volume successfully.
Jul 03 23:59:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9c6a291e-8401-4a7c-aee0-358acd334321 tempest-VolumesServicesTestJSON-385764225 None] Lock "cinder-a15d6620-158d-4269-a481-a9c09eefd9d6-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cde0ad42-5714-4024-9167-d14dfe4c5452 tempest-VolumesActionsTest-2078845086 None] Acquiring lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318" by "attach_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cde0ad42-5714-4024-9167-d14dfe4c5452 tempest-VolumesActionsTest-2078845086 None] Lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318" acquired by "attach_volume" :: waited 0.039s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cde0ad42-5714-4024-9167-d14dfe4c5452 tempest-VolumesActionsTest-2078845086 None] Attaching volume da7c006a-a5ac-441b-b381-1c9c5b841318 to instance aac7fbae-7dad-4c87-94bc-e784d3f388e7 at mountpoint /dev/vdb on host None.
Jul 03 23:59:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cde0ad42-5714-4024-9167-d14dfe4c5452 tempest-VolumesActionsTest-2078845086 None] Attach volume completed successfully.
Jul 03 23:59:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cde0ad42-5714-4024-9167-d14dfe4c5452 tempest-VolumesActionsTest-2078845086 None] Lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318" released by "attach_volume" :: held 0.188s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a88a7cf9-972c-48a8-9d6b-e9bde2806b2e tempest-VolumesActionsTest-2078845086 None] Acquiring lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318-detach_volume" by "detach_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a88a7cf9-972c-48a8-9d6b-e9bde2806b2e tempest-VolumesActionsTest-2078845086 None] Lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a88a7cf9-972c-48a8-9d6b-e9bde2806b2e tempest-VolumesActionsTest-2078845086 None] Detaching volume da7c006a-a5ac-441b-b381-1c9c5b841318 from instance aac7fbae-7dad-4c87-94bc-e784d3f388e7.
Jul 03 23:59:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a88a7cf9-972c-48a8-9d6b-e9bde2806b2e tempest-VolumesActionsTest-2078845086 None] Detach volume completed successfully.
Jul 03 23:59:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a88a7cf9-972c-48a8-9d6b-e9bde2806b2e tempest-VolumesActionsTest-2078845086 None] Lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:23 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=13,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:59:23 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=18,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Flow 'volume_create_manager' (aaea6164-2800-4b7f-8a8f-95a349741a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812da999-318b-484c-9664-8a2cb4925ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (812da999-318b-484c-9664-8a2cb4925ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1288044163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8df3f1-21fe-4b0b-bb40-ae09109c4208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2719b19b1c4ab2ac0aa416b788e75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:34Z,use_quota=True,user_id='b7fa25502741468ebe88faf49ef0a671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec5652a-9891-404d-99b1-16fc7450c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec5652a-9891-404d-99b1-16fc7450c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280955b9-5226-4d17-a49d-b29344a56cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.image.glance [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Creating Keystone auth plugin from conf {{(pid=86648) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280955b9-5226-4d17-a49d-b29344a56cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe8df3f1-21fe-4b0b-bb40-ae09109c4208', 'volume_name': 'volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208', 'volume_size': 1, 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c411eeda2924759a25bfc54b8e705a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c8c4410>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800e40cd-273b-4f0e-a944-82480075f0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800e40cd-273b-4f0e-a944-82480075f0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34905c85-d832-47b9-8008-c4bcbe6ed7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:34 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Volume fe8df3f1-21fe-4b0b-bb40-ae09109c4208: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208', 'volume_size': 1, 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c411eeda2924759a25bfc54b8e705a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c8c4410>}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Trying to clone fe8df3f1-21fe-4b0b-bb40-ae09109c4208 from image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]). {{(pid=86648) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 23:59:34 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d36b34-2e02-405e-b038-f0f56838ed77]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:34 devstack sudo[97040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD
Jul 03 23:59:34 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:36 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD" returned: 0 in 1.232s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:36 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Temporary image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc is fetched for user b7fa25502741468ebe88faf49ef0a671. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 23:59:36 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efc99e1-e590-41bf-81a0-3a7aebd08512]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:36 devstack sudo[97099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD
Jul 03 23:59:36 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:37 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD" returned: 0 in 0.858s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1288044163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8df3f1-21fe-4b0b-bb40-ae09109c4208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2719b19b1c4ab2ac0aa416b788e75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:34Z,use_quota=True,user_id='b7fa25502741468ebe88faf49ef0a671',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Creating volume fe8df3f1-21fe-4b0b-bb40-ae09109c4208 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:37 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:59:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:37 devstack sudo[97130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 1073741824
Jul 03 23:59:37 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:38 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 1073741824" returned: 0 in 1.043s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:38 devstack sudo[97138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208
Jul 03 23:59:38 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:39 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208" returned: 0 in 0.997s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Attempting download of 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc ((None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}])) to volume fe8df3f1-21fe-4b0b-bb40-ae09109c4208. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff08502-83b3-40f3-a478-25138518834e]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_6106y0pv {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:39 devstack sudo[97141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_6106y0pv
Jul 03 23:59:39 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Flow 'volume_create_manager' (11cefac8-b143-49eb-9579-728fb2098898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b649a84-4e13-46da-9a27-c734eefe4c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b649a84-4e13-46da-9a27-c734eefe4c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1986672839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3790bba-5996-49f5-afac-36d78a9c7743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c235cc0527e446188b9e2d36caa78710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:40Z,use_quota=True,user_id='bc0a775864c4475ead030529037e7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08774ee-749f-4e8a-8b80-80b4809ac94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c08774ee-749f-4e8a-8b80-80b4809ac94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250806b2-2450-4370-b5af-3d0391a60aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250806b2-2450-4370-b5af-3d0391a60aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3790bba-5996-49f5-afac-36d78a9c7743', 'volume_name': 'volume-b3790bba-5996-49f5-afac-36d78a9c7743', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7aa06e6-2566-4d20-a729-05378c384e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7aa06e6-2566-4d20-a729-05378c384e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09cabc4-379e-428b-bf26-78b4e5ba17e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:39 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Volume b3790bba-5996-49f5-afac-36d78a9c7743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3790bba-5996-49f5-afac-36d78a9c7743', 'volume_size': 1}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1986672839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3790bba-5996-49f5-afac-36d78a9c7743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c235cc0527e446188b9e2d36caa78710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:40Z,use_quota=True,user_id='bc0a775864c4475ead030529037e7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Creating volume b3790bba-5996-49f5-afac-36d78a9c7743 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:39 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 03 23:59:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b3790bba-5996-49f5-afac-36d78a9c7743 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:39 devstack sudo[97143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b3790bba-5996-49f5-afac-36d78a9c7743 1073741824
Jul 03 23:59:39 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:40 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_6106y0pv" returned: 0 in 1.185s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_6106y0pv {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b40b00c8-793e-4078-9fba-f0c2f86fbae2 tempest-VolumesActionsTest-2078845086 None] Acquiring lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318" by "attach_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b40b00c8-793e-4078-9fba-f0c2f86fbae2 tempest-VolumesActionsTest-2078845086 None] Lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318" acquired by "attach_volume" :: waited 0.036s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:40 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b40b00c8-793e-4078-9fba-f0c2f86fbae2 tempest-VolumesActionsTest-2078845086 None] Attaching volume da7c006a-a5ac-441b-b381-1c9c5b841318 to instance 45d5b442-6080-4d3f-8866-7aabc570aa7a at mountpoint /dev/vdb on host None.
Jul 03 23:59:40 devstack sudo[97148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_6106y0pv
Jul 03 23:59:40 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b40b00c8-793e-4078-9fba-f0c2f86fbae2 tempest-VolumesActionsTest-2078845086 None] Attach volume completed successfully.
Jul 03 23:59:40 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b40b00c8-793e-4078-9fba-f0c2f86fbae2 tempest-VolumesActionsTest-2078845086 None] Lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318" released by "attach_volume" :: held 0.158s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:41 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b3790bba-5996-49f5-afac-36d78a9c7743 1073741824" returned: 0 in 1.265s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b3790bba-5996-49f5-afac-36d78a9c7743 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:41 devstack sudo[97155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b3790bba-5996-49f5-afac-36d78a9c7743
Jul 03 23:59:41 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a1e9a803-bc76-4d9a-96f6-12bc1c956306 tempest-VolumesActionsTest-2078845086 None] Acquiring lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318-detach_volume" by "detach_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a1e9a803-bc76-4d9a-96f6-12bc1c956306 tempest-VolumesActionsTest-2078845086 None] Lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:41 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a1e9a803-bc76-4d9a-96f6-12bc1c956306 tempest-VolumesActionsTest-2078845086 None] Detaching volume da7c006a-a5ac-441b-b381-1c9c5b841318 from instance 45d5b442-6080-4d3f-8866-7aabc570aa7a.
Jul 03 23:59:41 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a1e9a803-bc76-4d9a-96f6-12bc1c956306 tempest-VolumesActionsTest-2078845086 None] Detach volume completed successfully.
Jul 03 23:59:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a1e9a803-bc76-4d9a-96f6-12bc1c956306 tempest-VolumesActionsTest-2078845086 None] Lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318-detach_volume" released by "detach_volume" :: held 0.128s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:41 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_6106y0pv" returned: 1 in 1.214s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_6106y0pv' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:59:41 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a3484c-88ea-44a5-8996-1246a780e632]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:41 devstack sudo[97159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD
Jul 03 23:59:41 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:42 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b3790bba-5996-49f5-afac-36d78a9c7743" returned: 0 in 1.016s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.340s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a09cabc4-379e-428b-bf26-78b4e5ba17e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3790bba-5996-49f5-afac-36d78a9c7743', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a04cf3-3889-4ace-a966-49314ad934d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:42 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Volume volume-b3790bba-5996-49f5-afac-36d78a9c7743 (b3790bba-5996-49f5-afac-36d78a9c7743): created successfully
Jul 03 23:59:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a04cf3-3889-4ace-a966-49314ad934d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Flow 'volume_create_manager' (11cefac8-b143-49eb-9579-728fb2098898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-77d7ba86-4617-4725-b0b4-40bbfbe49ff1 tempest-VolumesActionsTest-1307685601 None] Created volume successfully.
Jul 03 23:59:42 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD" returned: 0 in 1.179s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:43 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc was qcow2, converting to raw {{(pid=86648) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 23:59:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cf30d60c-31de-4607-b30d-862cece28f96 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "cinder-b3790bba-5996-49f5-afac-36d78a9c7743" by "attach_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:43 devstack sudo[97166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208
Jul 03 23:59:43 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cf30d60c-31de-4607-b30d-862cece28f96 tempest-VolumesActionsTest-1307685601 None] Lock "cinder-b3790bba-5996-49f5-afac-36d78a9c7743" acquired by "attach_volume" :: waited 0.033s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:43 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cf30d60c-31de-4607-b30d-862cece28f96 tempest-VolumesActionsTest-1307685601 None] Attaching volume b3790bba-5996-49f5-afac-36d78a9c7743 to instance 8d97d551-949e-4995-8b20-ad1cf3b7021f at mountpoint /dev/vdb on host None.
Jul 03 23:59:43 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cf30d60c-31de-4607-b30d-862cece28f96 tempest-VolumesActionsTest-1307685601 None] Attach volume completed successfully.
Jul 03 23:59:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cf30d60c-31de-4607-b30d-862cece28f96 tempest-VolumesActionsTest-1307685601 None] Lock "cinder-b3790bba-5996-49f5-afac-36d78a9c7743" released by "attach_volume" :: held 0.127s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1fb2ce8d-fad1-4be6-ad30-c1461b7dd6df tempest-VolumesActionsTest-1110468161 None] Terminate volume connection completed successfully.
Jul 03 23:59:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1fb2ce8d-fad1-4be6-ad30-c1461b7dd6df tempest-VolumesActionsTest-1110468161 None] Acquiring lock "cinder-b3790bba-5996-49f5-afac-36d78a9c7743-detach_volume" by "detach_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1fb2ce8d-fad1-4be6-ad30-c1461b7dd6df tempest-VolumesActionsTest-1110468161 None] Lock "cinder-b3790bba-5996-49f5-afac-36d78a9c7743-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1fb2ce8d-fad1-4be6-ad30-c1461b7dd6df tempest-VolumesActionsTest-1110468161 None] Detaching volume b3790bba-5996-49f5-afac-36d78a9c7743 from instance 8d97d551-949e-4995-8b20-ad1cf3b7021f.
Jul 03 23:59:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1fb2ce8d-fad1-4be6-ad30-c1461b7dd6df tempest-VolumesActionsTest-1110468161 None] Detach volume completed successfully.
Jul 03 23:59:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1fb2ce8d-fad1-4be6-ad30-c1461b7dd6df tempest-VolumesActionsTest-1110468161 None] Lock "cinder-b3790bba-5996-49f5-afac-36d78a9c7743-detach_volume" released by "detach_volume" :: held 0.169s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c5dfc1d5-e316-49ea-b716-339b7e96673c tempest-VolumesActionsTest-1307685601 None] Acquiring lock "cinder-b3790bba-5996-49f5-afac-36d78a9c7743-detach_volume" by "detach_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c5dfc1d5-e316-49ea-b716-339b7e96673c tempest-VolumesActionsTest-1307685601 None] Lock "cinder-b3790bba-5996-49f5-afac-36d78a9c7743-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:45 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c5dfc1d5-e316-49ea-b716-339b7e96673c tempest-VolumesActionsTest-1307685601 None] Volume detach called, but volume not attached.
Jul 03 23:59:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c5dfc1d5-e316-49ea-b716-339b7e96673c tempest-VolumesActionsTest-1307685601 None] Lock "cinder-b3790bba-5996-49f5-afac-36d78a9c7743-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:45 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208" returned: 0 in 2.581s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:45 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_wgk5uri3devstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:59:45 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Converted 112.00 MB image at 43.36 MB/s
Jul 03 23:59:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:45 devstack sudo[97196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 1G
Jul 03 23:59:45 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "cinder-b3790bba-5996-49f5-afac-36d78a9c7743-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Lock "cinder-b3790bba-5996-49f5-afac-36d78a9c7743-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "cinder-quobyte-b3790bba-5996-49f5-afac-36d78a9c7743" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Lock "cinder-quobyte-b3790bba-5996-49f5-afac-36d78a9c7743" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:46 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdc87e1-99f0-4812-a2df-c52ee55f2e23]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b3790bba-5996-49f5-afac-36d78a9c7743 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:46 devstack sudo[97202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b3790bba-5996-49f5-afac-36d78a9c7743
Jul 03 23:59:46 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:46 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 1G" returned: 0 in 0.826s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:46 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bab206-2115-414c-a2f6-1815b5a3d332]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:46 devstack sudo[97205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208
Jul 03 23:59:46 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:47 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b3790bba-5996-49f5-afac-36d78a9c7743" returned: 0 in 0.809s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b3790bba-5996-49f5-afac-36d78a9c7743 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:47 devstack sudo[97210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b3790bba-5996-49f5-afac-36d78a9c7743
Jul 03 23:59:47 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:47 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208" returned: 0 in 0.886s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:47 devstack sudo[97214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208
Jul 03 23:59:47 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:47 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b3790bba-5996-49f5-afac-36d78a9c7743" returned: 0 in 0.746s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Lock "cinder-quobyte-b3790bba-5996-49f5-afac-36d78a9c7743" released by "delete_volume" :: held 1.607s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:47 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Created reservations ['78388322-e7d4-4cad-8113-0dc1ba27ee80', '30f234a8-c343-4ba3-8bd9-c83cf0ca3b5b', '909e64fe-2cad-4274-a3ef-03076d7fa920', 'b93f8d72-6ecd-4b89-9244-b6819ce8fdef'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:48 devstack sudo[97220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:59:48 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:48 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208" returned: 1 in 0.785s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Downloaded image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc ((None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}])) to volume fe8df3f1-21fe-4b0b-bb40-ae09109c4208 successfully. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Temporary image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc for user b7fa25502741468ebe88faf49ef0a671 is deleted. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Marking volume fe8df3f1-21fe-4b0b-bb40-ae09109c4208 as bootable. {{(pid=86648) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Copying metadata from image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc to fe8df3f1-21fe-4b0b-bb40-ae09109c4208. {{(pid=86648) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Creating volume glance metadata for volume fe8df3f1-21fe-4b0b-bb40-ae09109c4208 backed by image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86648) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34905c85-d832-47b9-8008-c4bcbe6ed7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208', 'volume_size': 1, 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c411eeda2924759a25bfc54b8e705a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c8c4410>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98b66cc-9c23-4a63-a932-a9e7aff8b025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:48 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Volume volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 (fe8df3f1-21fe-4b0b-bb40-ae09109c4208): created successfully
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98b66cc-9c23-4a63-a932-a9e7aff8b025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Flow 'volume_create_manager' (aaea6164-2800-4b7f-8a8f-95a349741a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9f48d0ed-7e66-4d26-9e7b-1284b6b79d35 tempest-VolumesImageMetadata-150330134 None] Created volume successfully.
Jul 03 23:59:48 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.741s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:59:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Deleted volume successfully.
Jul 03 23:59:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d7eb174e-7447-45f1-b31c-0861fede9094 tempest-VolumesActionsTest-1307685601 None] Lock "cinder-b3790bba-5996-49f5-afac-36d78a9c7743-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Acquiring lock "cinder-fe8df3f1-21fe-4b0b-bb40-ae09109c4208-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Lock "cinder-fe8df3f1-21fe-4b0b-bb40-ae09109c4208-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Acquiring lock "cinder-quobyte-fe8df3f1-21fe-4b0b-bb40-ae09109c4208" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Lock "cinder-quobyte-fe8df3f1-21fe-4b0b-bb40-ae09109c4208" acquired by "delete_volume" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:49 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18a7a98-a35c-4742-8e70-7408884db597]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:50 devstack sudo[97251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208
Jul 03 23:59:50 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:51 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208" returned: 0 in 1.034s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:51 devstack sudo[97272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208
Jul 03 23:59:51 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:51 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208" returned: 1 in 0.893s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:59:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:51 devstack sudo[97279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208
Jul 03 23:59:51 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7842a6-dd39-48c8-8dbf-9415d8f1679d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:52 devstack sudo[97281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318
Jul 03 23:59:52 devstack sudo[97281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:52 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fe8df3f1-21fe-4b0b-bb40-ae09109c4208" returned: 0 in 0.703s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Lock "cinder-quobyte-fe8df3f1-21fe-4b0b-bb40-ae09109c4208" released by "delete_volume" :: held 2.699s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Created reservations ['057df42b-c096-4b2b-906b-2472428422ae', '74ad8a7c-28fb-4bed-8fc5-ea4accc9563d', 'baf183c7-f59b-4fc5-815b-35fdf7c78bda', '5b841020-90e9-4759-98a3-13b6e1cc5daf'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:52 devstack sudo[97284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 03 23:59:52 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:53 devstack sudo[97281]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318" returned: 0 in 0.772s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:53 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a6689f-4d96-4609-a1be-db49c79ddbd3]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:53 devstack sudo[97289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318
Jul 03 23:59:53 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:53 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.688s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:53 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:59:53 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Deleted volume successfully.
Jul 03 23:59:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f8c8091e-89bf-432f-bd4a-de3553562f13 tempest-VolumesImageMetadata-150330134 None] Lock "cinder-fe8df3f1-21fe-4b0b-bb40-ae09109c4208-delete_volume" released by "delete_volume" :: held 3.677s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:53 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318" returned: 0 in 0.840s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.c1e5b15c-3445-425d-993d-61b62a1e8cc26ckytiaj.img {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:54 devstack sudo[97295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.c1e5b15c-3445-425d-993d-61b62a1e8cc26ckytiaj.img
Jul 03 23:59:54 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:57 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:59:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Flow 'volume_create_manager' (3f035819-b70d-435b-a8ba-422dd73e1c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33b0571-38f8-4ea1-8fbe-c7e8c822dc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e33b0571-38f8-4ea1-8fbe-c7e8c822dc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-521449416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef019e58-b431-401b-94dd-bccd683ccbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c235cc0527e446188b9e2d36caa78710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:58Z,use_quota=True,user_id='bc0a775864c4475ead030529037e7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641a9e78-4043-468d-8a24-b7fe2670936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641a9e78-4043-468d-8a24-b7fe2670936a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4be975c-943b-4b29-883f-fd1602abc32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4be975c-943b-4b29-883f-fd1602abc32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef019e58-b431-401b-94dd-bccd683ccbc1', 'volume_name': 'volume-ef019e58-b431-401b-94dd-bccd683ccbc1', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dde5263-40b5-47a6-b8dd-2e3d725389fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dde5263-40b5-47a6-b8dd-2e3d725389fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd02aa7a-15c5-4344-a246-af3c084cbc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:58 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Volume ef019e58-b431-401b-94dd-bccd683ccbc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef019e58-b431-401b-94dd-bccd683ccbc1', 'volume_size': 1}
Jul 03 23:59:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:58 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.c1e5b15c-3445-425d-993d-61b62a1e8cc26ckytiaj.img" returned: 0 in 4.959s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eb6037-5e4f-4897-a204-8370038c4627]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:59 devstack sudo[97308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318
Jul 03 23:59:59 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:59 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318" returned: 0 in 1.011s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:59 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318, size 1024.00 MB, duration 4.96 sec, destination /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.c1e5b15c-3445-425d-993d-61b62a1e8cc26ckytiaj.img {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:59:59 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] Converted 1024.00 MB image at 206.46 MB/s
Jul 03 23:59:59 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] c1e5b15c-3445-425d-993d-61b62a1e8cc2 was raw, no need to convert to raw {{(pid=86648) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 04 00:00:01 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Flow 'volume_create_manager' (857816fa-7dd3-477e-9b4c-1992a1cd0946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2b5bd0-2bea-4ab6-926e-bac8d6d0d4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db2b5bd0-2bea-4ab6-926e-bac8d6d0d4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-478105512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413f0f21-f763-4d5a-bc4a-5ffef7e379f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03a9e49081af49caa7d58af54690f429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:01Z,use_quota=True,user_id='9b4b0d8434664ea9b05836c51a0970b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcdcd7b-c24c-4318-bd7b-8b7aa39eb492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbcdcd7b-c24c-4318-bd7b-8b7aa39eb492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bb87c1-9af5-489d-92ae-b7126f20ee6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14bb87c1-9af5-489d-92ae-b7126f20ee6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '413f0f21-f763-4d5a-bc4a-5ffef7e379f1', 'volume_name': 'volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1679d89-1f2b-4a92-a103-e87e8ef47a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1679d89-1f2b-4a92-a103-e87e8ef47a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123558d5-2c74-4b69-b642-c62aeafeb1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:01 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Volume 413f0f21-f763-4d5a-bc4a-5ffef7e379f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1', 'volume_size': 1}
Jul 04 00:00:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:00:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:05 devstack sudo[97315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:00:05 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:05 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.704s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:00:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:00:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:00:11 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=40,cinder:INSERT=15,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:00:11 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=39,cinder:UPDATE=33,cinder:INSERT=12,cinder:DELETE=2 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:00:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.732s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] Uploaded volume to glance image-id: c1e5b15c-3445-425d-993d-61b62a1e8cc2. {{(pid=86648) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 04 00:00:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.831s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-521449416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef019e58-b431-401b-94dd-bccd683ccbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c235cc0527e446188b9e2d36caa78710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:58Z,use_quota=True,user_id='bc0a775864c4475ead030529037e7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Creating volume ef019e58-b431-401b-94dd-bccd683ccbc1 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:19 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:00:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ef019e58-b431-401b-94dd-bccd683ccbc1 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:19 devstack sudo[97428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ef019e58-b431-401b-94dd-bccd683ccbc1 1073741824
Jul 04 00:00:19 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:19 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f6cd5322-b63b-4133-8947-34b48ae327ee tempest-VolumesActionsTest-2078845086 None] Copy volume to image completed successfully.
Jul 04 00:00:20 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ef019e58-b431-401b-94dd-bccd683ccbc1 1073741824" returned: 0 in 0.914s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ef019e58-b431-401b-94dd-bccd683ccbc1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:20 devstack sudo[97434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ef019e58-b431-401b-94dd-bccd683ccbc1
Jul 04 00:00:20 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:20 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ef019e58-b431-401b-94dd-bccd683ccbc1" returned: 0 in 0.702s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.254s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-478105512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413f0f21-f763-4d5a-bc4a-5ffef7e379f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03a9e49081af49caa7d58af54690f429',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:01Z,use_quota=True,user_id='9b4b0d8434664ea9b05836c51a0970b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Creating volume 413f0f21-f763-4d5a-bc4a-5ffef7e379f1 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:20 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:20 devstack sudo[97438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1 1073741824
Jul 04 00:00:20 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd02aa7a-15c5-4344-a246-af3c084cbc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef019e58-b431-401b-94dd-bccd683ccbc1', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5f097e-440f-4237-9164-b2be50e5c2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:20 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Volume volume-ef019e58-b431-401b-94dd-bccd683ccbc1 (ef019e58-b431-401b-94dd-bccd683ccbc1): created successfully
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea5f097e-440f-4237-9164-b2be50e5c2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Flow 'volume_create_manager' (3f035819-b70d-435b-a8ba-422dd73e1c90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:20 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-eda78d54-832d-4766-a4a5-6bed9b3e42ac tempest-VolumesActionsTest-1307685601 None] Created volume successfully.
Jul 04 00:00:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Acquiring lock "cinder-ef019e58-b431-401b-94dd-bccd683ccbc1-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Lock "cinder-ef019e58-b431-401b-94dd-bccd683ccbc1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Acquiring lock "cinder-quobyte-ef019e58-b431-401b-94dd-bccd683ccbc1" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Lock "cinder-quobyte-ef019e58-b431-401b-94dd-bccd683ccbc1" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:21 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fa520c-9ce1-46f8-bca0-9c515ab4c1e4]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ef019e58-b431-401b-94dd-bccd683ccbc1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:21 devstack sudo[97440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ef019e58-b431-401b-94dd-bccd683ccbc1
Jul 04 00:00:21 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:21 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1 1073741824" returned: 0 in 0.917s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:21 devstack sudo[97445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1
Jul 04 00:00:21 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:22 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ef019e58-b431-401b-94dd-bccd683ccbc1" returned: 0 in 0.835s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ef019e58-b431-401b-94dd-bccd683ccbc1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:22 devstack sudo[97450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ef019e58-b431-401b-94dd-bccd683ccbc1
Jul 04 00:00:22 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:22 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1" returned: 0 in 0.671s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.940s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123558d5-2c74-4b69-b642-c62aeafeb1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cfad86-9f4c-4afa-993c-c79530d6a362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a308b3-da7f-4b91-a339-88fe5f9e9623]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:22 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Volume volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1 (413f0f21-f763-4d5a-bc4a-5ffef7e379f1): created successfully
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cfad86-9f4c-4afa-993c-c79530d6a362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Flow 'volume_create_manager' (857816fa-7dd3-477e-9b4c-1992a1cd0946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:22 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-afc32613-7d61-4fbf-9253-1656303e6c66 tempest-VolumesMetadataTest-1262871654 None] Created volume successfully.
Jul 04 00:00:22 devstack sudo[97453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318
Jul 04 00:00:22 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:22 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ef019e58-b431-401b-94dd-bccd683ccbc1" returned: 0 in 0.690s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Lock "cinder-quobyte-ef019e58-b431-401b-94dd-bccd683ccbc1" released by "delete_volume" :: held 1.565s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Created reservations ['4d95fe43-1d5d-454a-88e3-a99f63323469', 'c96bc79f-2fd0-4a07-8bfc-dd73a0312b45', '76b13099-37ad-4ddc-b999-83338f9d9c5e', '0c972653-2189-418c-8b37-ef5fc73b53a1'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:22 devstack sudo[97456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:00:22 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:23 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318" returned: 0 in 0.825s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:23 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[535503ab-019c-4864-81fe-769e546e9c22]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:23 devstack sudo[97461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318
Jul 04 00:00:23 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Acquiring lock "cinder-413f0f21-f763-4d5a-bc4a-5ffef7e379f1-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Lock "cinder-413f0f21-f763-4d5a-bc4a-5ffef7e379f1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Acquiring lock "cinder-quobyte-413f0f21-f763-4d5a-bc4a-5ffef7e379f1" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Lock "cinder-quobyte-413f0f21-f763-4d5a-bc4a-5ffef7e379f1" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:23 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0587005a-27b1-4119-8753-b277b83ce641]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:23 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.755s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:23 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:23 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Deleted volume successfully.
Jul 04 00:00:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8072aed8-db65-4a9a-9f51-1e3939590d7d tempest-VolumesActionsTest-1110468161 None] Lock "cinder-ef019e58-b431-401b-94dd-bccd683ccbc1-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:23 devstack sudo[97464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1
Jul 04 00:00:23 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Flow 'volume_create_manager' (5311f8a4-74bb-4c20-b802-d28187879f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0cff3fe-8581-41e6-81a1-aab08800722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0cff3fe-8581-41e6-81a1-aab08800722a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1490059879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01038e32-1029-432c-80dc-e4fa50f7e49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c235cc0527e446188b9e2d36caa78710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:24Z,use_quota=True,user_id='bc0a775864c4475ead030529037e7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc44573-fb4c-48f1-ad10-d02ebd59923b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc44573-fb4c-48f1-ad10-d02ebd59923b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e694f4-e283-4d57-8255-47ec5c6bf64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6e694f4-e283-4d57-8255-47ec5c6bf64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01038e32-1029-432c-80dc-e4fa50f7e49b', 'volume_name': 'volume-01038e32-1029-432c-80dc-e4fa50f7e49b', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff50ffa-5d0c-461e-af0e-cc42e2effbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ff50ffa-5d0c-461e-af0e-cc42e2effbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:24 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17e8459-2fd7-486f-be99-2d8c27ccab60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:24 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Volume 01038e32-1029-432c-80dc-e4fa50f7e49b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01038e32-1029-432c-80dc-e4fa50f7e49b', 'volume_size': 1}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318" returned: 0 in 0.978s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:24 devstack sudo[97469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img
Jul 04 00:00:24 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:24 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1" returned: 0 in 0.830s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:24 devstack sudo[97480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1
Jul 04 00:00:24 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:25 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-413f0f21-f763-4d5a-bc4a-5ffef7e379f1" returned: 0 in 0.793s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Lock "cinder-quobyte-413f0f21-f763-4d5a-bc4a-5ffef7e379f1" released by "delete_volume" :: held 1.691s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:25 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Created reservations ['5b92270c-e89e-41f7-b479-184bf0288839', 'f859a421-c53d-4d86-b0b6-e1438ac6aeb6', '15fba0d4-9f28-4d5a-9322-efec54784abf', '69749f0d-b992-49c4-844b-fe0433cd914c'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:25 devstack sudo[97493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:00:25 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:27 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.706s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:27 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Deleted volume successfully.
Jul 04 00:00:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4bf38e5f-02b1-425c-a3ad-e89d8c67ef91 tempest-VolumesMetadataTest-1262871654 None] Lock "cinder-413f0f21-f763-4d5a-bc4a-5ffef7e379f1-delete_volume" released by "delete_volume" :: held 3.914s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:29 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img" returned: 0 in 5.192s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:29 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[035f134f-271f-4eba-879a-bb702aa1e04c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:29 devstack sudo[97498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318
Jul 04 00:00:29 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:30 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318" returned: 0 in 1.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:30 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:00:30 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Converted 1024.00 MB image at 197.18 MB/s
Jul 04 00:00:30 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] bee4a89d-d1dc-4743-bbee-fc7ff5564af5 was raw, converting to qcow2 {{(pid=86648) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 04 00:00:30 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd9b6b2-ef23-4ede-aa6f-7596b06a6b06]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:30 devstack sudo[97504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img
Jul 04 00:00:30 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:31 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img" returned: 0 in 0.729s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:31 devstack sudo[97508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img
Jul 04 00:00:31 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:31 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img" returned: 1 in 0.721s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:00:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img /opt/stack/data/cinder/conversion/vol_upload_khvaaf3t {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:31 devstack sudo[97515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img /opt/stack/data/cinder/conversion/vol_upload_khvaaf3t
Jul 04 00:00:31 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:32 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img /opt/stack/data/cinder/conversion/vol_upload_khvaaf3t" returned: 0 in 0.876s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:32 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Image conversion details: src /opt/stack/data/cinder/conversion/da7c006a-a5ac-441b-b381-1c9c5b841318.temp_image.bee4a89d-d1dc-4743-bbee-fc7ff5564af56601raf4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_khvaaf3t {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:00:32 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 04 00:00:32 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8038d60-3650-4e53-ae34-bf4320d3a2c5]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_khvaaf3t {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:33 devstack sudo[97520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_khvaaf3t
Jul 04 00:00:33 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Flow 'volume_create_manager' (8aaa79d5-9883-488d-8604-5c7dfeaf0a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d347b2-8c1c-4b02-a92f-d8f803eceb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d347b2-8c1c-4b02-a92f-d8f803eceb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2080989879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d423d2-a44a-4aa1-b875-1ab536ea3d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='874f0152ac2d4de5a45aa98c17a89f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:33Z,use_quota=True,user_id='5e1b5818e3044feca9615197c1518203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ab68bb-0588-4f3e-aefe-ab9df611be16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ab68bb-0588-4f3e-aefe-ab9df611be16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd00a239-971c-423c-8b97-ce24c2c53c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd00a239-971c-423c-8b97-ce24c2c53c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d423d2-a44a-4aa1-b875-1ab536ea3d83', 'volume_name': 'volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd491a22-aca7-4f50-b9ef-a69c05ca5827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd491a22-aca7-4f50-b9ef-a69c05ca5827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c9a6a1-b1af-4518-9a6f-ceffd61372ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:33 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Volume c6d423d2-a44a-4aa1-b875-1ab536ea3d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83', 'volume_size': 1}
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:33 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_khvaaf3t" returned: 0 in 0.799s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.629s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Uploaded volume to glance image-id: bee4a89d-d1dc-4743-bbee-fc7ff5564af5. {{(pid=86648) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.779s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1490059879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01038e32-1029-432c-80dc-e4fa50f7e49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c235cc0527e446188b9e2d36caa78710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:24Z,use_quota=True,user_id='bc0a775864c4475ead030529037e7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Creating volume 01038e32-1029-432c-80dc-e4fa50f7e49b {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:35 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-01038e32-1029-432c-80dc-e4fa50f7e49b 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:35 devstack sudo[97525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-01038e32-1029-432c-80dc-e4fa50f7e49b 1073741824
Jul 04 00:00:35 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:35 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-084ca260-a5e0-4606-8b4d-b75d238c2ef4 tempest-VolumesActionsTest-2078845086 None] Copy volume to image completed successfully.
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Acquiring lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Acquiring lock "cinder-quobyte-da7c006a-a5ac-441b-b381-1c9c5b841318" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Lock "cinder-quobyte-da7c006a-a5ac-441b-b381-1c9c5b841318" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d762c92-ae5e-453e-b4bd-58430d921f0d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:36 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-01038e32-1029-432c-80dc-e4fa50f7e49b 1073741824" returned: 0 in 1.035s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-01038e32-1029-432c-80dc-e4fa50f7e49b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:36 devstack sudo[97532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-01038e32-1029-432c-80dc-e4fa50f7e49b
Jul 04 00:00:36 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:36 devstack sudo[97531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318
Jul 04 00:00:36 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:36 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-01038e32-1029-432c-80dc-e4fa50f7e49b" returned: 0 in 0.649s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.653s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2080989879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d423d2-a44a-4aa1-b875-1ab536ea3d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='874f0152ac2d4de5a45aa98c17a89f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:33Z,use_quota=True,user_id='5e1b5818e3044feca9615197c1518203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Creating volume c6d423d2-a44a-4aa1-b875-1ab536ea3d83 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:36 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:36 devstack sudo[97539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83 1073741824
Jul 04 00:00:36 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a17e8459-2fd7-486f-be99-2d8c27ccab60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01038e32-1029-432c-80dc-e4fa50f7e49b', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cecaa41-9d4a-46e0-9fdc-a2b43e8eac58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:36 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Volume volume-01038e32-1029-432c-80dc-e4fa50f7e49b (01038e32-1029-432c-80dc-e4fa50f7e49b): created successfully
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cecaa41-9d4a-46e0-9fdc-a2b43e8eac58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Flow 'volume_create_manager' (5311f8a4-74bb-4c20-b802-d28187879f0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:36 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ad20d1f1-18c2-4bd8-8003-3ba21e312a46 tempest-VolumesActionsTest-1307685601 None] Created volume successfully.
Jul 04 00:00:36 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318" returned: 0 in 0.860s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:36 devstack sudo[97541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318
Jul 04 00:00:36 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Acquiring lock "cinder-01038e32-1029-432c-80dc-e4fa50f7e49b-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Lock "cinder-01038e32-1029-432c-80dc-e4fa50f7e49b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Acquiring lock "cinder-quobyte-01038e32-1029-432c-80dc-e4fa50f7e49b" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Lock "cinder-quobyte-01038e32-1029-432c-80dc-e4fa50f7e49b" acquired by "delete_volume" :: waited 0.028s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00b94d3-8918-42b5-a8d4-86980cd1d4e0]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-01038e32-1029-432c-80dc-e4fa50f7e49b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:37 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da7c006a-a5ac-441b-b381-1c9c5b841318" returned: 0 in 0.727s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:37 devstack sudo[97546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-01038e32-1029-432c-80dc-e4fa50f7e49b
Jul 04 00:00:37 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Lock "cinder-quobyte-da7c006a-a5ac-441b-b381-1c9c5b841318" released by "delete_volume" :: held 1.631s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Created reservations ['987fa900-6ca1-4787-9518-68a3c3e4a08a', '312bde69-845f-45ec-b2ec-ad32cf573c67', '9fe89671-59de-4a0e-8c27-20761f6e52b1', '6f361079-1912-4b3b-9789-22bccefe7129'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:37 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83 1073741824" returned: 0 in 0.989s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:37 devstack sudo[97549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:00:37 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:37 devstack sudo[97551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83
Jul 04 00:00:37 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:38 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-01038e32-1029-432c-80dc-e4fa50f7e49b" returned: 0 in 0.943s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-01038e32-1029-432c-80dc-e4fa50f7e49b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:38 devstack sudo[97558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-01038e32-1029-432c-80dc-e4fa50f7e49b
Jul 04 00:00:38 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:38 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.751s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:38 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Deleted volume successfully.
Jul 04 00:00:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b11619fe-1c27-470a-a221-462ba48c16d6 tempest-VolumesActionsTest-2078845086 None] Lock "cinder-da7c006a-a5ac-441b-b381-1c9c5b841318-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:38 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83" returned: 0 in 0.801s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.867s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19c9a6a1-b1af-4518-9a6f-ceffd61372ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455e912a-47ed-4a08-b0ea-7b0c539270ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:38 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Volume volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83 (c6d423d2-a44a-4aa1-b875-1ab536ea3d83): created successfully
Jul 04 00:00:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (455e912a-47ed-4a08-b0ea-7b0c539270ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Flow 'volume_create_manager' (8aaa79d5-9883-488d-8604-5c7dfeaf0a02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-67e080ff-e26e-421f-8839-5eabbf755542 tempest-VolumesTransfersTest-485883027 None] Created volume successfully.
Jul 04 00:00:39 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-01038e32-1029-432c-80dc-e4fa50f7e49b" returned: 0 in 0.774s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Lock "cinder-quobyte-01038e32-1029-432c-80dc-e4fa50f7e49b" released by "delete_volume" :: held 1.760s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:39 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Created reservations ['e5e417ad-7698-46d0-b1be-712119e2b75a', '3aa7c962-6e8d-43e4-8df1-9b23e82cae95', '0e45beb7-a2de-4e3e-8c13-f45b799fed2a', 'd60197f9-e105-4b5c-8de3-2a2d0b62e7dd'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:39 devstack sudo[97562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:00:39 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:40 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.910s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:40 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Deleted volume successfully.
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3b22434e-2994-4b03-a324-fc434f08e2f5 tempest-VolumesActionsTest-1110468161 None] Lock "cinder-01038e32-1029-432c-80dc-e4fa50f7e49b-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:40 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-34a09bde-a51a-4061-a7d4-4b0f45c37331 tempest-VolumesTransfersTest-1566106407 None] Transfer volume completed successfully.
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Flow 'volume_create_manager' (aad1333d-0e9d-4907-961f-b74cc5c62e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dfdccc5-f6c1-48c1-80dd-1cab052d914a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dfdccc5-f6c1-48c1-80dd-1cab052d914a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-147980499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c235cc0527e446188b9e2d36caa78710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:41Z,use_quota=True,user_id='bc0a775864c4475ead030529037e7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4fb316-f96a-4d91-a3d6-d59c35d6296a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4fb316-f96a-4d91-a3d6-d59c35d6296a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e8c7f6-685b-4305-9a9c-4ab57d27a9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e8c7f6-685b-4305-9a9c-4ab57d27a9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a', 'volume_name': 'volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514b6380-359d-4e2e-b251-5a4c0f76de2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514b6380-359d-4e2e-b251-5a4c0f76de2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec52bbb7-8cff-4f65-9af4-1f7bd533d4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:40 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Volume cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a', 'volume_size': 1}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-147980499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c235cc0527e446188b9e2d36caa78710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:41Z,use_quota=True,user_id='bc0a775864c4475ead030529037e7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Creating volume cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:40 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:00:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:40 devstack sudo[97567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a 1073741824
Jul 04 00:00:40 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Acquiring lock "cinder-c6d423d2-a44a-4aa1-b875-1ab536ea3d83-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Lock "cinder-c6d423d2-a44a-4aa1-b875-1ab536ea3d83-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Acquiring lock "cinder-quobyte-c6d423d2-a44a-4aa1-b875-1ab536ea3d83" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Lock "cinder-quobyte-c6d423d2-a44a-4aa1-b875-1ab536ea3d83" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:41 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a 1073741824" returned: 0 in 1.264s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:42 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb620af-b2ae-4840-a9ce-d721d3d4bd1d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:42 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a
Jul 04 00:00:42 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:42 devstack sudo[97573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83
Jul 04 00:00:42 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:42 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a" returned: 0 in 0.830s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec52bbb7-8cff-4f65-9af4-1f7bd533d4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6843b73-158b-4d8a-9ade-28f34b167f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:42 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Volume volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a (cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a): created successfully
Jul 04 00:00:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6843b73-158b-4d8a-9ade-28f34b167f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Flow 'volume_create_manager' (aad1333d-0e9d-4907-961f-b74cc5c62e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2d3fc58c-7c39-4ad6-82bd-f18ebd778109 tempest-VolumesActionsTest-1307685601 None] Created volume successfully.
Jul 04 00:00:43 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83" returned: 0 in 1.010s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:43 devstack sudo[97581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83
Jul 04 00:00:43 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:43 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d423d2-a44a-4aa1-b875-1ab536ea3d83" returned: 0 in 0.690s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Lock "cinder-quobyte-c6d423d2-a44a-4aa1-b875-1ab536ea3d83" released by "delete_volume" :: held 1.768s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Created reservations ['727d01ea-6980-427d-a691-9ea686c962d5', '9f7ce6e1-fe63-4e3d-97d9-b088e301456b', '70f9cb84-8cf9-4a10-8212-60de0b58f71f', '1f720725-0d2a-4cc1-b5cd-c8e05b03d372'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Acquiring lock "cinder-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Lock "cinder-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:43 devstack sudo[97585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:00:43 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Acquiring lock "cinder-quobyte-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Lock "cinder-quobyte-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2503b5e7-7cd0-42cc-a7e7-5fea6086cf05]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:44 devstack sudo[97587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a
Jul 04 00:00:44 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:44 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.786s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Deleted volume successfully.
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cb65cc2f-3769-47a3-923f-11fa2692b22b tempest-VolumesTransfersTest-568283738 None] Lock "cinder-c6d423d2-a44a-4aa1-b875-1ab536ea3d83-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Flow 'volume_create_manager' (8e58cc99-6b76-498f-8903-a5be9e01155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75abad4-4461-4bc5-828f-c47e395f38c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f75abad4-4461-4bc5-828f-c47e395f38c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-546887691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8738b4-fc73-4e5b-b336-ae33565ca63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='874f0152ac2d4de5a45aa98c17a89f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:45Z,use_quota=True,user_id='5e1b5818e3044feca9615197c1518203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8832dce-85c1-46d2-a6ad-6b148edc04f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8832dce-85c1-46d2-a6ad-6b148edc04f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cf57dd-c65d-4169-bd99-53a73ff37836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cf57dd-c65d-4169-bd99-53a73ff37836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd8738b4-fc73-4e5b-b336-ae33565ca63b', 'volume_name': 'volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03b4e15-4618-4074-8720-098859d27b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03b4e15-4618-4074-8720-098859d27b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef453e1-80df-417a-8904-18124d14164f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:44 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Volume fd8738b4-fc73-4e5b-b336-ae33565ca63b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b', 'volume_size': 1}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-546887691',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd8738b4-fc73-4e5b-b336-ae33565ca63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='874f0152ac2d4de5a45aa98c17a89f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:45Z,use_quota=True,user_id='5e1b5818e3044feca9615197c1518203',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Creating volume fd8738b4-fc73-4e5b-b336-ae33565ca63b {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:44 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:44 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:44 devstack sudo[97593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b 1073741824
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a" returned: 0 in 0.920s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:44 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:44 devstack sudo[97595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a
Jul 04 00:00:44 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:45 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a" returned: 0 in 0.720s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Lock "cinder-quobyte-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a" released by "delete_volume" :: held 1.688s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Created reservations ['e83a014a-69b3-4f48-a21d-459aad3c774c', 'b95c840e-ed9d-4431-af78-247a71c74492', '340ad6a4-5e51-47b0-b850-1fc912a3d6c0', 'd3fa0043-4e56-4d2f-b746-f15a2adb9a20'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:45 devstack sudo[97602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:00:45 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:45 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Flow 'volume_create_manager' (06c52d6d-c3db-4716-b9a3-a8e25945e19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc75061-dcd6-4c24-ae0e-c871e1a62545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b 1073741824" returned: 0 in 1.019s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dc75061-dcd6-4c24-ae0e-c871e1a62545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-205454754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726a9c5e-b117-49c8-bbed-626889590ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3ffaa16af7461884ff60ce35353fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:46Z,use_quota=True,user_id='b5806daadbdb4dec810fa784e98db9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ebd2c1-257f-4afa-a6be-596633269682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ebd2c1-257f-4afa-a6be-596633269682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd6f1e0-c50d-45bb-95a5-10f7672a69e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acd6f1e0-c50d-45bb-95a5-10f7672a69e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726a9c5e-b117-49c8-bbed-626889590ab0', 'volume_name': 'volume-726a9c5e-b117-49c8-bbed-626889590ab0', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f09cd80-7649-4aa7-879e-a6537f62a7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f09cd80-7649-4aa7-879e-a6537f62a7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831957a2-421d-4996-93dc-78edc6c2525f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:46 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Volume 726a9c5e-b117-49c8-bbed-626889590ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726a9c5e-b117-49c8-bbed-626889590ab0', 'volume_size': 1}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:46 devstack sudo[97604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b
Jul 04 00:00:46 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:46 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.701s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:46 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Deleted volume successfully.
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-eea6b4b4-b6c8-4db5-a664-4d50654728bd tempest-VolumesActionsTest-1110468161 None] Lock "cinder-cf0c2bcb-55dd-4ca1-b2e5-cf4665b6fe7a-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:46 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b" returned: 0 in 0.707s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.735s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-205454754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726a9c5e-b117-49c8-bbed-626889590ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3ffaa16af7461884ff60ce35353fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:46Z,use_quota=True,user_id='b5806daadbdb4dec810fa784e98db9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Creating volume 726a9c5e-b117-49c8-bbed-626889590ab0 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:46 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:46 devstack sudo[97609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 1073741824
Jul 04 00:00:46 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef453e1-80df-417a-8904-18124d14164f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb73b99e-ea44-4d66-8f19-666da7a7bfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:46 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Volume volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b (fd8738b4-fc73-4e5b-b336-ae33565ca63b): created successfully
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb73b99e-ea44-4d66-8f19-666da7a7bfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Flow 'volume_create_manager' (8e58cc99-6b76-498f-8903-a5be9e01155c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Flow 'volume_create_manager' (ddc320ee-dc0f-46d8-8147-f80f74f404de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ae7301-cbf0-46f2-95f4-48a5f74621a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:46 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-32ed7e05-9228-4b62-93c9-c45ec478f37f tempest-VolumesTransfersTest-485883027 None] Created volume successfully.
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ae7301-cbf0-46f2-95f4-48a5f74621a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929091665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec41cfd-dd31-4d53-b89b-beca2d66226f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c235cc0527e446188b9e2d36caa78710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:47Z,use_quota=True,user_id='bc0a775864c4475ead030529037e7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b29217d-ba9c-4878-8ea6-c0d7ab91b04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b29217d-ba9c-4878-8ea6-c0d7ab91b04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92b1776-3d55-4be7-9196-7928962832f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92b1776-3d55-4be7-9196-7928962832f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec41cfd-dd31-4d53-b89b-beca2d66226f', 'volume_name': 'volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5918c24-02b3-4928-ab38-c1026eb61219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5918c24-02b3-4928-ab38-c1026eb61219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3056ca19-5aeb-4c41-b4dc-cf4154582059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:46 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Volume 0ec41cfd-dd31-4d53-b89b-beca2d66226f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f', 'volume_size': 1}
Jul 04 00:00:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:47 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 1073741824" returned: 0 in 0.805s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:47 devstack sudo[97615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0
Jul 04 00:00:47 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Acquiring lock "cinder-fd8738b4-fc73-4e5b-b336-ae33565ca63b-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Lock "cinder-fd8738b4-fc73-4e5b-b336-ae33565ca63b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:48 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0" returned: 0 in 0.676s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929091665',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec41cfd-dd31-4d53-b89b-beca2d66226f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c235cc0527e446188b9e2d36caa78710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:47Z,use_quota=True,user_id='bc0a775864c4475ead030529037e7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Creating volume 0ec41cfd-dd31-4d53-b89b-beca2d66226f {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:48 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:48 devstack sudo[97618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f 1073741824
Jul 04 00:00:48 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831957a2-421d-4996-93dc-78edc6c2525f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726a9c5e-b117-49c8-bbed-626889590ab0', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e042cca-ff8f-4a11-b752-c659516925d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Acquiring lock "cinder-quobyte-fd8738b4-fc73-4e5b-b336-ae33565ca63b" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:48 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Volume volume-726a9c5e-b117-49c8-bbed-626889590ab0 (726a9c5e-b117-49c8-bbed-626889590ab0): created successfully
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e042cca-ff8f-4a11-b752-c659516925d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Flow 'volume_create_manager' (06c52d6d-c3db-4716-b9a3-a8e25945e19f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Lock "cinder-quobyte-fd8738b4-fc73-4e5b-b336-ae33565ca63b" acquired by "delete_volume" :: waited 0.036s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2e7535bf-0ff5-4b58-bab1-1651013fd230 tempest-VolumesCloneTest-1050401209 None] Created volume successfully.
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e79182f-28ad-4bb9-807b-7a01c0e5f03f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:48 devstack sudo[97620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b
Jul 04 00:00:48 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:49 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f 1073741824" returned: 0 in 0.913s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:49 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b" returned: 0 in 0.828s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:49 devstack sudo[97628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b
Jul 04 00:00:49 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:49 devstack sudo[97629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f
Jul 04 00:00:49 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Flow 'volume_create_manager' (2a22d7eb-514a-4859-bdf5-dc411a8762e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368555f7-c4f1-4098-a2d3-cad4c5c7058a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368555f7-c4f1-4098-a2d3-cad4c5c7058a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1065604592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e57f0ac8-8dc4-4e27-bc4b-11c380c85c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3ffaa16af7461884ff60ce35353fd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=726a9c5e-b117-49c8-bbed-626889590ab0,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:50Z,use_quota=True,user_id='b5806daadbdb4dec810fa784e98db9f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13761c91-47bf-40f8-9852-96815a407a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13761c91-47bf-40f8-9852-96815a407a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22594254-3348-4ef3-8745-762f8eee7890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22594254-3348-4ef3-8745-762f8eee7890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e57f0ac8-8dc4-4e27-bc4b-11c380c85c51', 'volume_name': 'volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51', 'volume_size': 2, 'source_volid': '726a9c5e-b117-49c8-bbed-626889590ab0', 'source_volstatus': 'available'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbabcd4f-6baa-4e3b-8ff9-2afabc793a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbabcd4f-6baa-4e3b-8ff9-2afabc793a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb6059f-74d3-4402-bede-9b0675f8e1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:49 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Volume e57f0ac8-8dc4-4e27-bc4b-11c380c85c51: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51', 'volume_size': 2, 'source_volid': '726a9c5e-b117-49c8-bbed-626889590ab0', 'source_volstatus': 'available'}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:49 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fd8738b4-fc73-4e5b-b336-ae33565ca63b" returned: 0 in 0.692s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Lock "cinder-quobyte-fd8738b4-fc73-4e5b-b336-ae33565ca63b" released by "delete_volume" :: held 1.568s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:49 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f" returned: 0 in 0.693s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.164s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:49 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Cloning volume 726a9c5e-b117-49c8-bbed-626889590ab0 to volume e57f0ac8-8dc4-4e27-bc4b-11c380c85c51
Jul 04 00:00:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3056ca19-5aeb-4c41-b4dc-cf4154582059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e23c66-5e1a-4930-a0f0-eeca014bbb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Creating offline snapshot dcc1e1a4-b247-4d50-91bb-fde1f7582598 of volume 726a9c5e-b117-49c8-bbed-626889590ab0 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:00:50 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Volume volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f (0ec41cfd-dd31-4d53-b89b-beca2d66226f): created successfully
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05e23c66-5e1a-4930-a0f0-eeca014bbb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Flow 'volume_create_manager' (ddc320ee-dc0f-46d8-8147-f80f74f404de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be014fc-c342-4a8b-b104-152d861c0e5c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:50 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ac223527-3ee3-421c-ad1e-57b4b768fa4f tempest-VolumesActionsTest-1307685601 None] Created volume successfully.
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Created reservations ['f3e32dde-8ec4-483a-a02c-b6a1f383d2fe', '45c3a117-90e7-4979-8d96-84dcbc8b1be0', 'bd540462-80be-41c4-8b24-bddbaf91152a', 'ba2c702a-5a36-450a-875f-c5e8e0284151'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:50 devstack sudo[97634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0
Jul 04 00:00:50 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:50 devstack sudo[97635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:00:50 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:50 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.743s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:50 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Deleted volume successfully.
Jul 04 00:00:50 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0" returned: 0 in 0.875s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f96e7668-7782-47a3-9c92-ed63b6244c29 tempest-VolumesTransfersTest-568283738 None] Lock "cinder-fd8738b4-fc73-4e5b-b336-ae33565ca63b-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:50 devstack sudo[97643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598 1G
Jul 04 00:00:50 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Acquiring lock "cinder-0ec41cfd-dd31-4d53-b89b-beca2d66226f-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Lock "cinder-0ec41cfd-dd31-4d53-b89b-beca2d66226f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Acquiring lock "cinder-quobyte-0ec41cfd-dd31-4d53-b89b-beca2d66226f" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Lock "cinder-quobyte-0ec41cfd-dd31-4d53-b89b-beca2d66226f" acquired by "delete_volume" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:51 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[457ff341-edd1-4be9-b972-eeced8a6fb09]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:51 devstack sudo[97645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f
Jul 04 00:00:51 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:51 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598 1G" returned: 0 in 0.921s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726a9c5e-b117-49c8-bbed-626889590ab0 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:51 devstack sudo[97651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726a9c5e-b117-49c8-bbed-626889590ab0 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598
Jul 04 00:00:51 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:52 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f" returned: 0 in 0.908s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:52 devstack sudo[97656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f
Jul 04 00:00:52 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:52 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-726a9c5e-b117-49c8-bbed-626889590ab0 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598" returned: 0 in 0.847s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:52 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598 is being set with open permissions: ugo+rw
Jul 04 00:00:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:52 devstack sudo[97661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598
Jul 04 00:00:52 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:52 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0ec41cfd-dd31-4d53-b89b-beca2d66226f" returned: 0 in 0.730s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Lock "cinder-quobyte-0ec41cfd-dd31-4d53-b89b-beca2d66226f" released by "delete_volume" :: held 1.691s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:52 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Created reservations ['0dca0760-81a0-4db3-97f4-14d8b25ab728', 'd89ac293-8b2f-43a6-8344-5796e10587e6', '6e70ea1d-ba14-497b-91fe-425e05dc9396', 'ec8af512-1374-4f2a-898f-96ccd9a84f20'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:53 devstack sudo[97664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:00:53 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:53 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598" returned: 0 in 0.784s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:53 devstack sudo[97667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.info
Jul 04 00:00:53 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:53 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.769s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:53 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:53 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Deleted volume successfully.
Jul 04 00:00:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ee9bcce1-6ae8-4d5a-bf7f-ff8e23715fbf tempest-VolumesActionsTest-1110468161 None] Lock "cinder-0ec41cfd-dd31-4d53-b89b-beca2d66226f-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Flow 'volume_create_manager' (163dd0c2-edf4-4b83-8e9a-1c35885b9e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3634d4-c269-49eb-954d-77a507f4b26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e3634d4-c269-49eb-954d-77a507f4b26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-295117683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00021cf9-9c3b-47b8-a106-747ac269ee57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c235cc0527e446188b9e2d36caa78710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:54Z,use_quota=True,user_id='bc0a775864c4475ead030529037e7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b29a260-6390-43ff-bc68-4397bf5a2ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b29a260-6390-43ff-bc68-4397bf5a2ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb6e26e-05d5-477d-a115-3e6441f8eee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb6e26e-05d5-477d-a115-3e6441f8eee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00021cf9-9c3b-47b8-a106-747ac269ee57', 'volume_name': 'volume-00021cf9-9c3b-47b8-a106-747ac269ee57', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f24554e-6de9-4962-827b-3284fdc44609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f24554e-6de9-4962-827b-3284fdc44609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bf62be-8933-43cb-a33f-78b615bf0d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:54 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Volume 00021cf9-9c3b-47b8-a106-747ac269ee57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00021cf9-9c3b-47b8-a106-747ac269ee57', 'volume_size': 1}
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:54 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.info" returned: 0 in 0.841s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:54 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.info is being set with open permissions: ugo+rw
Jul 04 00:00:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:54 devstack sudo[97671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.info
Jul 04 00:00:54 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:55 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.info" returned: 0 in 0.686s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Acquiring lock "cinder-quobyte-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51" by "_copy_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Lock "cinder-quobyte-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] snapshot: dcc1e1a4-b247-4d50-91bb-fde1f7582598, volume: e57f0ac8-8dc4-4e27-bc4b-11c380c85c51,  {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:00:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:55 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7787efb5-69d2-408c-bb7c-ab54f3043bd2]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:55 devstack sudo[97674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598
Jul 04 00:00:55 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:56 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598" returned: 0 in 0.885s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-726a9c5e-b117-49c8-bbed-626889590ab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:00:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] will copy from snapshot at /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:00:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Creating direct copy from snapshot {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:00:56 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f57bc2-40f8-4d73-ada1-eac8c8b7ddb3]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:56 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0
Jul 04 00:00:56 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:56 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0" returned: 0 in 0.754s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:56 devstack cinder-volume[86648]: DEBUG cinder.utils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Path /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51 not found in is_blk_device check {{(pid=86648) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:00:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:56 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51
Jul 04 00:00:56 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:57 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Flow 'volume_create_manager' (5af1d792-c578-49ff-b4f9-041040586245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48fc59b-eef9-427c-801b-0dd78980fd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48fc59b-eef9-427c-801b-0dd78980fd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1522352144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c531974f-7bca-45a7-b30e-21f1d75d48f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd28c4ab6b434e81ba51ab37518d4624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:57Z,use_quota=True,user_id='b7df12a640084fdeb94fbd27efeb4f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c64a11-c263-4dff-9264-554d70eb567c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c64a11-c263-4dff-9264-554d70eb567c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbd1518-84d7-4062-b6c5-7dffffde87d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afbd1518-84d7-4062-b6c5-7dffffde87d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c531974f-7bca-45a7-b30e-21f1d75d48f5', 'volume_name': 'volume-c531974f-7bca-45a7-b30e-21f1d75d48f5', 'volume_size': 2}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfe3c6e-063d-4970-ae2b-9067f7d5bb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dfe3c6e-063d-4970-ae2b-9067f7d5bb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdcbafc-31b5-4a94-8879-2843c0b5bcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:57 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Volume c531974f-7bca-45a7-b30e-21f1d75d48f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c531974f-7bca-45a7-b30e-21f1d75d48f5', 'volume_size': 2}
Jul 04 00:00:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:01 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51" returned: 0 in 4.220s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:01 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f70082-ed41-4293-85d8-891842f945ba]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:01 devstack sudo[97700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0
Jul 04 00:01:01 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:01 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0" returned: 0 in 0.915s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:01 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0, size 1024.00 MB, duration 4.22 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:01:01 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Converted 1024.00 MB image at 242.56 MB/s
Jul 04 00:01:01 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51 is being set with open permissions: ugo+rw
Jul 04 00:01:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:01 devstack sudo[97705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51
Jul 04 00:01:01 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:02 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51" returned: 0 in 0.627s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Lock "cinder-quobyte-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51" released by "_copy_volume_from_snapshot" :: held 7.490s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Acquiring lock "cinder-quobyte-dcc1e1a4-b247-4d50-91bb-fde1f7582598" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Lock "cinder-quobyte-dcc1e1a4-b247-4d50-91bb-fde1f7582598" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Deleting offline snapshot dcc1e1a4-b247-4d50-91bb-fde1f7582598 of volume 726a9c5e-b117-49c8-bbed-626889590ab0 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:01:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] snapshot_file for this snap is: volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:01:02 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f633ef-69b6-45a0-ba6e-94194b61e700]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:02 devstack sudo[97708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598
Jul 04 00:01:02 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:03 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598" returned: 0 in 0.893s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-726a9c5e-b117-49c8-bbed-626889590ab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:01:03 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f939e4-005d-459b-8f3a-81fb00f1f353]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:03 devstack sudo[97714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0
Jul 04 00:01:03 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:04 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0" returned: 0 in 0.807s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:04 devstack sudo[97719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598
Jul 04 00:01:04 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:05 devstack sudo[97724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:01:05 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:05 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598" returned: 0 in 0.875s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:05 devstack sudo[97726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598
Jul 04 00:01:05 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:05 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.710s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:01:05 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0.dcc1e1a4-b247-4d50-91bb-fde1f7582598" returned: 0 in 0.707s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Lock "cinder-quobyte-dcc1e1a4-b247-4d50-91bb-fde1f7582598" released by "_delete_snapshot" :: held 3.386s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.073s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.849s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-295117683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00021cf9-9c3b-47b8-a106-747ac269ee57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c235cc0527e446188b9e2d36caa78710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:54Z,use_quota=True,user_id='bc0a775864c4475ead030529037e7f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Creating volume 00021cf9-9c3b-47b8-a106-747ac269ee57 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:06 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-00021cf9-9c3b-47b8-a106-747ac269ee57 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:06 devstack sudo[97732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-00021cf9-9c3b-47b8-a106-747ac269ee57 1073741824
Jul 04 00:01:06 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb6059f-74d3-4402-bede-9b0675f8e1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51', 'volume_size': 2, 'source_volid': '726a9c5e-b117-49c8-bbed-626889590ab0', 'source_volstatus': 'available'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce43c51-aadc-4382-8a8a-d41a962e7958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:06 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Volume volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51 (e57f0ac8-8dc4-4e27-bc4b-11c380c85c51): created successfully
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce43c51-aadc-4382-8a8a-d41a962e7958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Flow 'volume_create_manager' (2a22d7eb-514a-4859-bdf5-dc411a8762e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:06 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-23c31dec-7561-4be1-895b-df7f21f8eb04 tempest-VolumesCloneTest-1050401209 None] Created volume successfully.
Jul 04 00:01:06 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-00021cf9-9c3b-47b8-a106-747ac269ee57 1073741824" returned: 0 in 0.840s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-00021cf9-9c3b-47b8-a106-747ac269ee57 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:06 devstack sudo[97738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-00021cf9-9c3b-47b8-a106-747ac269ee57
Jul 04 00:01:06 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Acquiring lock "cinder-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Lock "cinder-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Acquiring lock "cinder-quobyte-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Lock "cinder-quobyte-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[276a8cdf-08b4-4087-8c01-5f027af554e2]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:07 devstack sudo[97740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51
Jul 04 00:01:07 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:07 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-00021cf9-9c3b-47b8-a106-747ac269ee57" returned: 0 in 0.657s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.127s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1522352144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c531974f-7bca-45a7-b30e-21f1d75d48f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd28c4ab6b434e81ba51ab37518d4624',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:57Z,use_quota=True,user_id='b7df12a640084fdeb94fbd27efeb4f93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Creating volume c531974f-7bca-45a7-b30e-21f1d75d48f5 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:07 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c531974f-7bca-45a7-b30e-21f1d75d48f5 2147483648 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bf62be-8933-43cb-a33f-78b615bf0d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00021cf9-9c3b-47b8-a106-747ac269ee57', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c87032f-7cd9-4fb1-b944-e58ca747fdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:07 devstack sudo[97743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c531974f-7bca-45a7-b30e-21f1d75d48f5 2147483648
Jul 04 00:01:07 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:07 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Volume volume-00021cf9-9c3b-47b8-a106-747ac269ee57 (00021cf9-9c3b-47b8-a106-747ac269ee57): created successfully
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c87032f-7cd9-4fb1-b944-e58ca747fdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Flow 'volume_create_manager' (163dd0c2-edf4-4b83-8e9a-1c35885b9e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:07 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5f401acb-8260-4188-823d-3ae555eb339c tempest-VolumesActionsTest-1307685601 None] Created volume successfully.
Jul 04 00:01:08 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51" returned: 0 in 0.785s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:08 devstack sudo[97748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51
Jul 04 00:01:08 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:08 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c531974f-7bca-45a7-b30e-21f1d75d48f5 2147483648" returned: 0 in 1.102s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:08 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51" returned: 0 in 0.743s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Lock "cinder-quobyte-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51" released by "delete_volume" :: held 1.575s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c531974f-7bca-45a7-b30e-21f1d75d48f5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:08 devstack sudo[97755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c531974f-7bca-45a7-b30e-21f1d75d48f5
Jul 04 00:01:08 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:08 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Created reservations ['9ef34e8c-e013-4ffb-9e0d-a0c9c2f00bed', '9d95205b-37ab-40d8-ad8e-7459458345db', '579f860c-64ca-4b87-9902-5e67d0e07c96', '474ccda9-ff5d-499a-90c5-64c0a18a39d0'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "cinder-00021cf9-9c3b-47b8-a106-747ac269ee57-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Lock "cinder-00021cf9-9c3b-47b8-a106-747ac269ee57-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "cinder-quobyte-00021cf9-9c3b-47b8-a106-747ac269ee57" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Lock "cinder-quobyte-00021cf9-9c3b-47b8-a106-747ac269ee57" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:09 devstack sudo[97757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:01:09 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c01d75e-00e8-4a84-91c4-76ec79ca75a6]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-00021cf9-9c3b-47b8-a106-747ac269ee57 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:09 devstack sudo[97759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-00021cf9-9c3b-47b8-a106-747ac269ee57
Jul 04 00:01:09 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Acquiring lock "cinder-726a9c5e-b117-49c8-bbed-626889590ab0-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Lock "cinder-726a9c5e-b117-49c8-bbed-626889590ab0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Acquiring lock "cinder-quobyte-726a9c5e-b117-49c8-bbed-626889590ab0" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Lock "cinder-quobyte-726a9c5e-b117-49c8-bbed-626889590ab0" acquired by "delete_volume" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:09 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c531974f-7bca-45a7-b30e-21f1d75d48f5" returned: 0 in 0.788s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6d5ee4-1d34-442b-90cd-1abceff995d1]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdcbafc-31b5-4a94-8879-2843c0b5bcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c531974f-7bca-45a7-b30e-21f1d75d48f5', 'volume_size': 2}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c5a4e6-5d47-4f54-b5a0-66d4cf46659b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:09 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Volume volume-c531974f-7bca-45a7-b30e-21f1d75d48f5 (c531974f-7bca-45a7-b30e-21f1d75d48f5): created successfully
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c5a4e6-5d47-4f54-b5a0-66d4cf46659b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Flow 'volume_create_manager' (5af1d792-c578-49ff-b4f9-041040586245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-3b76ab40-8caf-436a-8ee4-91e0e84ca064 tempest-VolumesCloneNegativeTest-1174025966 None] Created volume successfully.
Jul 04 00:01:09 devstack sudo[97762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0
Jul 04 00:01:09 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:09 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.797s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Deleted volume successfully.
Jul 04 00:01:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-de1d80f9-606d-45e7-8cfa-12828a248d17 tempest-VolumesCloneTest-1050401209 None] Lock "cinder-e57f0ac8-8dc4-4e27-bc4b-11c380c85c51-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:10 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-00021cf9-9c3b-47b8-a106-747ac269ee57" returned: 0 in 0.937s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-00021cf9-9c3b-47b8-a106-747ac269ee57 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:10 devstack sudo[97769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-00021cf9-9c3b-47b8-a106-747ac269ee57
Jul 04 00:01:10 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Acquiring lock "cinder-c531974f-7bca-45a7-b30e-21f1d75d48f5-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Lock "cinder-c531974f-7bca-45a7-b30e-21f1d75d48f5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Acquiring lock "cinder-quobyte-c531974f-7bca-45a7-b30e-21f1d75d48f5" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Lock "cinder-quobyte-c531974f-7bca-45a7-b30e-21f1d75d48f5" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a09a8c-2001-4257-ade4-6be95270622e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c531974f-7bca-45a7-b30e-21f1d75d48f5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:10 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0" returned: 0 in 0.908s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:10 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0
Jul 04 00:01:10 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:10 devstack sudo[97789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c531974f-7bca-45a7-b30e-21f1d75d48f5
Jul 04 00:01:10 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:10 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-00021cf9-9c3b-47b8-a106-747ac269ee57" returned: 0 in 0.821s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Lock "cinder-quobyte-00021cf9-9c3b-47b8-a106-747ac269ee57" released by "delete_volume" :: held 1.814s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:10 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Created reservations ['b75aab4e-1c0e-402e-aeb6-51138fa5181b', '793f3e90-4590-42e5-bdc4-d20188de6383', 'c8ea3865-5f7e-4ff1-b42a-51a99b0049b2', '47606366-89fe-4fb0-bafa-6c601955e35e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:11 devstack sudo[97816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:01:11 devstack sudo[97816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:11 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c531974f-7bca-45a7-b30e-21f1d75d48f5" returned: 0 in 0.876s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c531974f-7bca-45a7-b30e-21f1d75d48f5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:11 devstack sudo[97822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c531974f-7bca-45a7-b30e-21f1d75d48f5
Jul 04 00:01:11 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:11 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-726a9c5e-b117-49c8-bbed-626889590ab0" returned: 0 in 0.910s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Lock "cinder-quobyte-726a9c5e-b117-49c8-bbed-626889590ab0" released by "delete_volume" :: held 1.910s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Created reservations ['f3a76bf2-f99d-4f82-a585-0bbe37605c90', '995ae33c-e5d3-4f5c-8c6b-76c1a1c81b2e', 'd2dbe28d-b9e4-49b9-b297-5b9911d1ab43', '7671ec06-067f-4302-bd8e-97081b4955d2'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:11 devstack sudo[97824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:01:11 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:12 devstack sudo[97816]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.000s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Deleted volume successfully.
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=66,cinder:UPDATE=115,cinder:INSERT=25,cinder:DELETE=14 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2d23ff62-e349-4902-8ff6-48b5aadc93f7 tempest-VolumesActionsTest-1307685601 None] Lock "cinder-00021cf9-9c3b-47b8-a106-747ac269ee57-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:12 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c531974f-7bca-45a7-b30e-21f1d75d48f5" returned: 0 in 1.099s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Lock "cinder-quobyte-c531974f-7bca-45a7-b30e-21f1d75d48f5" released by "delete_volume" :: held 2.028s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=99,cinder:UPDATE=131,cinder:INSERT=32,cinder:DELETE=7 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Created reservations ['48424a42-6d91-4ad1-a682-481f70542b46', 'b99e9d69-dd66-4322-99eb-41062a567769', '78dc7917-1cd5-4d7d-bbc9-6ed4c1cc1958', 'f6d42f4a-c18c-4838-bb9a-62f3f8e14755'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:12 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:12 devstack sudo[97829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:01:12 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.005s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Deleted volume successfully.
Jul 04 00:01:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1b501590-3578-49c1-b1ed-542a0d3ac4e8 tempest-VolumesCloneTest-1050401209 None] Lock "cinder-726a9c5e-b117-49c8-bbed-626889590ab0-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:13 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.807s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:13 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Deleted volume successfully.
Jul 04 00:01:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a4bd9783-30a7-43bf-a549-43b0ec0afc43 tempest-VolumesCloneNegativeTest-1174025966 None] Lock "cinder-c531974f-7bca-45a7-b30e-21f1d75d48f5-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (907aada3-4f6a-471c-8e10-7013b9b6b5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8d284c-87ce-4ea6-88b9-6402fc1803cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8d284c-87ce-4ea6-88b9-6402fc1803cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-719077725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc371400-c111-4695-a452-46768c1a9341,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:16Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a39a075-2337-41e4-9e1e-625ad70e5f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a39a075-2337-41e4-9e1e-625ad70e5f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f315bd4-a0b6-4a5c-8f6f-90a203433a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f315bd4-a0b6-4a5c-8f6f-90a203433a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc371400-c111-4695-a452-46768c1a9341', 'volume_name': 'volume-cc371400-c111-4695-a452-46768c1a9341', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe7589d-74ea-4d46-940d-794841aa1598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe7589d-74ea-4d46-940d-794841aa1598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf44074-fb5e-479e-8b8b-1ed4afbadfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:15 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Volume cc371400-c111-4695-a452-46768c1a9341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc371400-c111-4695-a452-46768c1a9341', 'volume_size': 1}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-719077725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc371400-c111-4695-a452-46768c1a9341,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:16Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Creating volume cc371400-c111-4695-a452-46768c1a9341 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:15 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:01:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cc371400-c111-4695-a452-46768c1a9341 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:15 devstack sudo[97833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cc371400-c111-4695-a452-46768c1a9341 1073741824
Jul 04 00:01:15 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:16 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cc371400-c111-4695-a452-46768c1a9341 1073741824" returned: 0 in 1.039s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cc371400-c111-4695-a452-46768c1a9341 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:17 devstack sudo[97840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cc371400-c111-4695-a452-46768c1a9341
Jul 04 00:01:17 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:17 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cc371400-c111-4695-a452-46768c1a9341" returned: 0 in 0.762s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf44074-fb5e-479e-8b8b-1ed4afbadfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc371400-c111-4695-a452-46768c1a9341', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0921f8a-cace-4d2e-94cc-aa27856c649b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:17 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Volume volume-cc371400-c111-4695-a452-46768c1a9341 (cc371400-c111-4695-a452-46768c1a9341): created successfully
Jul 04 00:01:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0921f8a-cace-4d2e-94cc-aa27856c649b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (907aada3-4f6a-471c-8e10-7013b9b6b5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:17 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-12cc1b6b-c5d0-469d-a016-dde1f74ea2ae tempest-VolumesGetTest-1332725268 None] Created volume successfully.
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (b221182d-a022-4be3-893b-714d67274c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc66b71-6506-4efa-a0a3-4a7e7ebdbfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc66b71-6506-4efa-a0a3-4a7e7ebdbfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1914986708',display_name='tempest-VolumesGetTest-Volume-747193676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6d00dd-b150-4a1c-aa5a-7c60d685c15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:20Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a46be47-6b98-4c7a-b8cd-72ee305168cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a46be47-6b98-4c7a-b8cd-72ee305168cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec6439e-3570-4b92-8e82-06d32e328aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec6439e-3570-4b92-8e82-06d32e328aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c6d00dd-b150-4a1c-aa5a-7c60d685c15f', 'volume_name': 'volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7ab44d-e5ca-4c58-bd33-2db7433f07be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7ab44d-e5ca-4c58-bd33-2db7433f07be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5879c4dd-3e88-415d-8f96-5a127ba4d072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:19 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Volume 2c6d00dd-b150-4a1c-aa5a-7c60d685c15f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f', 'volume_size': 1}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1914986708',display_name='tempest-VolumesGetTest-Volume-747193676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c6d00dd-b150-4a1c-aa5a-7c60d685c15f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:20Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Creating volume 2c6d00dd-b150-4a1c-aa5a-7c60d685c15f {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:19 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:01:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:19 devstack sudo[97844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f 1073741824
Jul 04 00:01:19 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:20 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f 1073741824" returned: 0 in 1.084s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:21 devstack sudo[97851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f
Jul 04 00:01:21 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:21 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f" returned: 0 in 0.827s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5879c4dd-3e88-415d-8f96-5a127ba4d072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2e19a6-4f34-4c44-a3be-f204a47aea82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:21 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Volume volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f (2c6d00dd-b150-4a1c-aa5a-7c60d685c15f): created successfully
Jul 04 00:01:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2e19a6-4f34-4c44-a3be-f204a47aea82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:21 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (b221182d-a022-4be3-893b-714d67274c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:21 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e6fd55a4-255c-4e0c-8dad-24c45bf9ca91 tempest-VolumesGetTest-1332725268 None] Created volume successfully.
Jul 04 00:01:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Lock "cinder-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-quobyte-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:23 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[202b41a7-ab4b-4732-9f1b-a20603165ac8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:23 devstack sudo[97855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f
Jul 04 00:01:23 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:24 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f" returned: 0 in 0.977s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:24 devstack sudo[97860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f
Jul 04 00:01:24 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:24 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f" returned: 0 in 0.756s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f" released by "delete_volume" :: held 1.789s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Created reservations ['0bb39ff2-3935-44ca-84d9-cc4edb9d7b26', 'c13c08ae-2c96-42b5-abce-40624bc12b3e', 'a0218742-cdd1-4c81-aaab-8982f2ab30da', 'af6e7045-d543-4789-a95c-87774177ce61'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:25 devstack sudo[97869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:01:25 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-cc371400-c111-4695-a452-46768c1a9341-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Lock "cinder-cc371400-c111-4695-a452-46768c1a9341-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-quobyte-cc371400-c111-4695-a452-46768c1a9341" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-cc371400-c111-4695-a452-46768c1a9341" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b809486a-f484-4c38-b3ab-6c4f18b3d974]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cc371400-c111-4695-a452-46768c1a9341 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:25 devstack sudo[97871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cc371400-c111-4695-a452-46768c1a9341
Jul 04 00:01:25 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:26 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.113s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:26 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:26 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Deleted volume successfully.
Jul 04 00:01:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b611a98a-5a72-48a4-8dc0-6c0b0004245d tempest-VolumesGetTest-1332725268 None] Lock "cinder-2c6d00dd-b150-4a1c-aa5a-7c60d685c15f-delete_volume" released by "delete_volume" :: held 3.279s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:26 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cc371400-c111-4695-a452-46768c1a9341" returned: 0 in 1.207s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cc371400-c111-4695-a452-46768c1a9341 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:26 devstack sudo[97877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cc371400-c111-4695-a452-46768c1a9341
Jul 04 00:01:26 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:27 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cc371400-c111-4695-a452-46768c1a9341" returned: 0 in 0.888s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-cc371400-c111-4695-a452-46768c1a9341" released by "delete_volume" :: held 2.158s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:27 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Created reservations ['f476b65c-ff67-4f88-b7c2-f1c2a8eb4584', 'c38a98d7-946f-43b8-8a1a-ca6ec9665d97', '50b472c1-d5ba-46ac-ac8d-16887703ef0b', '7aee6ac8-e49e-40ec-8715-c7fa932e021e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:28 devstack sudo[97882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:01:28 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Flow 'volume_create_manager' (7dcd935d-baa8-449a-a318-bff117549ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6cd008-0b6e-44dc-a7b5-09f733c5a4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab6cd008-0b6e-44dc-a7b5-09f733c5a4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1178371223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226a3ffa-9b5c-4c21-9112-2291c8c0a3e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73071c949d1b4b6491df341ef2027f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:29Z,use_quota=True,user_id='4e582a3bd83549208c17369a8770767e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b69bf3-1fe6-4667-85a7-84296a21e5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90b69bf3-1fe6-4667-85a7-84296a21e5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc7c3f8-12e3-4f1a-aaf3-52a4081b2bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc7c3f8-12e3-4f1a-aaf3-52a4081b2bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '226a3ffa-9b5c-4c21-9112-2291c8c0a3e4', 'volume_name': 'volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07450e6-982d-49ef-a08f-6213e81c2191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a07450e6-982d-49ef-a08f-6213e81c2191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8a785e-e79f-4a09-8719-c3c3b4bf275a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:28 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Volume 226a3ffa-9b5c-4c21-9112-2291c8c0a3e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4', 'volume_size': 1}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1178371223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=226a3ffa-9b5c-4c21-9112-2291c8c0a3e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73071c949d1b4b6491df341ef2027f26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:29Z,use_quota=True,user_id='4e582a3bd83549208c17369a8770767e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Creating volume 226a3ffa-9b5c-4c21-9112-2291c8c0a3e4 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:28 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:28 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.853s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:28 devstack sudo[97886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4 1073741824
Jul 04 00:01:28 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:28 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Deleted volume successfully.
Jul 04 00:01:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-30117421-c698-4fd3-beda-59c417d12a57 tempest-VolumesGetTest-1332725268 None] Lock "cinder-cc371400-c111-4695-a452-46768c1a9341-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (0310cef3-2bd8-450a-a38a-00aaa9386c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95dc50c-e60d-48a6-8523-a6dbd6764703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95dc50c-e60d-48a6-8523-a6dbd6764703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-499112562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19d4ede-e9ff-4273-a8f4-b656f88cc781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:30Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141d3bb1-3159-4078-b245-a3d89e06b733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141d3bb1-3159-4078-b245-a3d89e06b733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0076c7-32c8-436c-9f2f-57ac8b12eb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0076c7-32c8-436c-9f2f-57ac8b12eb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19d4ede-e9ff-4273-a8f4-b656f88cc781', 'volume_name': 'volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d4ffd8-ed12-4c1a-8182-c388abce9175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d4ffd8-ed12-4c1a-8182-c388abce9175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bed9b0f-d3ed-49ed-ba57-c83ba0543d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:29 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Volume a19d4ede-e9ff-4273-a8f4-b656f88cc781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781', 'volume_size': 1}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:29 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4 1073741824" returned: 0 in 1.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:29 devstack sudo[97892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4
Jul 04 00:01:29 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:30 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4" returned: 0 in 0.670s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-499112562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19d4ede-e9ff-4273-a8f4-b656f88cc781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:30Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Creating volume a19d4ede-e9ff-4273-a8f4-b656f88cc781 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:30 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b8a785e-e79f-4a09-8719-c3c3b4bf275a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf139fa-4fa5-4d82-8de2-b2ea5a5c319e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:30 devstack sudo[97896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 1073741824
Jul 04 00:01:30 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:30 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Volume volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4 (226a3ffa-9b5c-4c21-9112-2291c8c0a3e4): created successfully
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf139fa-4fa5-4d82-8de2-b2ea5a5c319e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Flow 'volume_create_manager' (7dcd935d-baa8-449a-a318-bff117549ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:30 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4a60f0ec-2839-4852-ac4e-d67026c125e9 tempest-AbsoluteLimitsTests-498607501 None] Created volume successfully.
Jul 04 00:01:31 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 1073741824" returned: 0 in 1.078s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:31 devstack sudo[97902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781
Jul 04 00:01:31 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Acquiring lock "cinder-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Lock "cinder-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Acquiring lock "cinder-quobyte-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Lock "cinder-quobyte-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fab414-37cd-4793-8994-ea534cd72ad9]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:32 devstack sudo[97904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4
Jul 04 00:01:32 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:32 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781" returned: 0 in 0.697s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bed9b0f-d3ed-49ed-ba57-c83ba0543d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d993ff12-7427-4f90-aeb9-9c718217b7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:32 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Volume volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 (a19d4ede-e9ff-4273-a8f4-b656f88cc781): created successfully
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d993ff12-7427-4f90-aeb9-9c718217b7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (0310cef3-2bd8-450a-a38a-00aaa9386c71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d1c0777e-e37e-4d4d-bb02-07cc7f321592 tempest-VolumesGetTest-1332725268 None] Created volume successfully.
Jul 04 00:01:32 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4" returned: 0 in 0.815s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:32 devstack sudo[97910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4
Jul 04 00:01:32 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (6af0675d-2f04-40e0-9bdf-1df68a49a4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295807de-0316-442b-a238-9e5f1f825785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (295807de-0316-442b-a238-9e5f1f825785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1637347135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f04e8e3-0ad1-4450-b353-f43662aee3ed,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=a19d4ede-e9ff-4273-a8f4-b656f88cc781,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:33Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0023be7-ed16-41ce-85ff-436c4ce0b103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0023be7-ed16-41ce-85ff-436c4ce0b103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527fff15-ed1a-49d4-ac27-e87cd6e63dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (527fff15-ed1a-49d4-ac27-e87cd6e63dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4f04e8e3-0ad1-4450-b353-f43662aee3ed', 'volume_name': 'volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed', 'volume_size': 1, 'source_volid': 'a19d4ede-e9ff-4273-a8f4-b656f88cc781', 'source_volstatus': 'available'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf34000-491b-407a-b4dd-ad63be91baf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf34000-491b-407a-b4dd-ad63be91baf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154d9df1-c34b-400e-a7e3-5a31cb7e16dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:33 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Volume 4f04e8e3-0ad1-4450-b353-f43662aee3ed: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed', 'volume_size': 1, 'source_volid': 'a19d4ede-e9ff-4273-a8f4-b656f88cc781', 'source_volstatus': 'available'}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:33 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Cloning volume a19d4ede-e9ff-4273-a8f4-b656f88cc781 to volume 4f04e8e3-0ad1-4450-b353-f43662aee3ed
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Creating offline snapshot 6a6ec3ae-328c-49ad-864f-3b79328cbece of volume a19d4ede-e9ff-4273-a8f4-b656f88cc781 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52b3640-3dc4-458b-99df-85c09230f877]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:33 devstack sudo[97912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781
Jul 04 00:01:33 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:33 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4" returned: 0 in 1.001s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Lock "cinder-quobyte-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4" released by "delete_volume" :: held 1.873s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:34 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Created reservations ['18c043b1-ddf6-406e-add5-11fb1feb3142', '87c1d536-28fd-4fe4-aa30-5e6a0b8434b6', '541435b3-22e4-48e9-b5b8-dd93e88e918e', '4661cd31-88a6-4d95-b65c-afd95e45b8e1'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:34 devstack sudo[97916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:01:34 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:34 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781" returned: 0 in 1.161s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:34 devstack sudo[97922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece 1G
Jul 04 00:01:34 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:35 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.153s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:35 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:35 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Deleted volume successfully.
Jul 04 00:01:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2f113f09-fe90-4196-8ff9-e2a870a85afa tempest-AbsoluteLimitsTests-498607501 None] Lock "cinder-226a3ffa-9b5c-4c21-9112-2291c8c0a3e4-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:36 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece 1G" returned: 0 in 1.286s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:36 devstack sudo[97928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece
Jul 04 00:01:36 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:37 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece" returned: 0 in 0.842s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:37 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece is being set with open permissions: ugo+rw
Jul 04 00:01:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:37 devstack sudo[97934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece
Jul 04 00:01:37 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:37 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece" returned: 0 in 0.914s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:38 devstack sudo[97937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.info
Jul 04 00:01:38 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:38 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.info" returned: 0 in 0.911s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:38 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.info is being set with open permissions: ugo+rw
Jul 04 00:01:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:38 devstack sudo[97940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.info
Jul 04 00:01:38 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:39 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.info" returned: 0 in 0.862s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-quobyte-4f04e8e3-0ad1-4450-b353-f43662aee3ed" by "_copy_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-4f04e8e3-0ad1-4450-b353-f43662aee3ed" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] snapshot: 6a6ec3ae-328c-49ad-864f-3b79328cbece, volume: 4f04e8e3-0ad1-4450-b353-f43662aee3ed,  {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:01:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:39 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2591ae6a-7137-4bb9-8134-c9feaac0128a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:39 devstack sudo[97943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece
Jul 04 00:01:39 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:40 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece" returned: 0 in 0.879s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:01:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] will copy from snapshot at /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:01:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Creating direct copy from snapshot {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:01:40 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a830a710-77b9-4d0b-ab79-da2bfcf9a62f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:40 devstack sudo[97954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781
Jul 04 00:01:40 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:41 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781" returned: 0 in 0.888s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:41 devstack cinder-volume[86648]: DEBUG cinder.utils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Path /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed not found in is_blk_device check {{(pid=86648) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:01:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:41 devstack sudo[97959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed
Jul 04 00:01:41 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:42 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Flow 'volume_create_manager' (4ae923e7-972a-4707-a2e2-457609141792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78dc4d0a-1e83-4eb9-9b95-88d2f3ba7691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78dc4d0a-1e83-4eb9-9b95-88d2f3ba7691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-347073907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f066b39efd46cb83ed76cc3aeb840b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:43Z,use_quota=True,user_id='2926c0bdda7547989bbbcfdae7a8b376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390cd1cd-da13-4713-8edd-91dc468f59b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390cd1cd-da13-4713-8edd-91dc468f59b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9210d610-994f-4298-97cc-fa82f90a9dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9210d610-994f-4298-97cc-fa82f90a9dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c1f77a-c4d4-430a-94a5-8aa3c411b8c9', 'volume_name': 'volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7420484f-be53-43b2-aa37-aad39dce0648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7420484f-be53-43b2-aa37-aad39dce0648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621516f4-0385-4396-bc2f-057abb52aa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:43 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Volume d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9', 'volume_size': 1}
Jul 04 00:01:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:46 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed" returned: 0 in 5.008s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:46 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ece0fd-bf2e-4a73-9785-e8a2e02d0bb2]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:46 devstack sudo[97976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781
Jul 04 00:01:46 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:47 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781" returned: 0 in 0.911s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:47 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:01:47 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Converted 1024.00 MB image at 204.45 MB/s
Jul 04 00:01:47 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed is being set with open permissions: ugo+rw
Jul 04 00:01:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:47 devstack sudo[97981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed
Jul 04 00:01:47 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:48 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed" returned: 0 in 0.622s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-4f04e8e3-0ad1-4450-b353-f43662aee3ed" released by "_copy_volume_from_snapshot" :: held 8.413s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-quobyte-6a6ec3ae-328c-49ad-864f-3b79328cbece" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-6a6ec3ae-328c-49ad-864f-3b79328cbece" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Deleting offline snapshot 6a6ec3ae-328c-49ad-864f-3b79328cbece of volume a19d4ede-e9ff-4273-a8f4-b656f88cc781 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:01:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] snapshot_file for this snap is: volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:01:48 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23efc14-7e2f-4ee5-9001-d0d7f76c1477]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:48 devstack sudo[97984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece
Jul 04 00:01:48 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:49 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece" returned: 0 in 0.933s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:01:49 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9488ef-3121-4962-9b8b-7bb378ef926e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:49 devstack sudo[97990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781
Jul 04 00:01:49 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:50 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781" returned: 0 in 0.876s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:50 devstack sudo[97997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece
Jul 04 00:01:50 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:50 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece" returned: 0 in 0.844s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:51 devstack sudo[98016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece
Jul 04 00:01:51 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:51 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781.6a6ec3ae-328c-49ad-864f-3b79328cbece" returned: 0 in 0.652s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-6a6ec3ae-328c-49ad-864f-3b79328cbece" released by "_delete_snapshot" :: held 3.414s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.029s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.611s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-347073907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f066b39efd46cb83ed76cc3aeb840b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:43Z,use_quota=True,user_id='2926c0bdda7547989bbbcfdae7a8b376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Creating volume d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:51 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:51 devstack sudo[98038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9 1073741824
Jul 04 00:01:51 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154d9df1-c34b-400e-a7e3-5a31cb7e16dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed', 'volume_size': 1, 'source_volid': 'a19d4ede-e9ff-4273-a8f4-b656f88cc781', 'source_volstatus': 'available'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38cc755-18cf-48d7-a2f0-47ee794318fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:51 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Volume volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed (4f04e8e3-0ad1-4450-b353-f43662aee3ed): created successfully
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a38cc755-18cf-48d7-a2f0-47ee794318fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (6af0675d-2f04-40e0-9bdf-1df68a49a4f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:51 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5fa28784-b106-4cc1-a12e-27eba1bd9c63 tempest-VolumesGetTest-1332725268 None] Created volume successfully.
Jul 04 00:01:52 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9 1073741824" returned: 0 in 0.904s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:52 devstack sudo[98043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9
Jul 04 00:01:52 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:52 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (ae396ccb-82e3-4174-86b9-5fa9bc84fc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c94de2b-fd2f-4610-9454-a4ceca2c8592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c94de2b-fd2f-4610-9454-a4ceca2c8592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1198036642',display_name='tempest-VolumesGetTest-Volume-1882289926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b586751-5ba1-4b59-abd7-b1551a7f4f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:53Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e3a834-e2c1-4cf5-808e-e59d52d3b60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e3a834-e2c1-4cf5-808e-e59d52d3b60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4a973f-95ea-4b6d-8d00-e7c4a2710295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4a973f-95ea-4b6d-8d00-e7c4a2710295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b586751-5ba1-4b59-abd7-b1551a7f4f77', 'volume_name': 'volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ee92ec-200f-4bdc-bfb6-4f2e77c5cf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ee92ec-200f-4bdc-bfb6-4f2e77c5cf26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854299a4-b8d9-4c24-ab0b-5baa6e8218c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:53 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Volume 1b586751-5ba1-4b59-abd7-b1551a7f4f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77', 'volume_size': 1}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9" returned: 0 in 0.697s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:53 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1198036642',display_name='tempest-VolumesGetTest-Volume-1882289926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b586751-5ba1-4b59-abd7-b1551a7f4f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:53Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Creating volume 1b586751-5ba1-4b59-abd7-b1551a7f4f77 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:53 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (621516f4-0385-4396-bc2f-057abb52aa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:53 devstack sudo[98049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77 1073741824
Jul 04 00:01:53 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ff7112-54fe-4d44-9638-247dc2eefc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:53 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Volume volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9 (d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9): created successfully
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8ff7112-54fe-4d44-9638-247dc2eefc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Flow 'volume_create_manager' (4ae923e7-972a-4707-a2e2-457609141792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:53 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f3ac75bb-6838-44fc-b11e-ece27feb9692 tempest-VolumesTransfersV357Test-328185926 None] Created volume successfully.
Jul 04 00:01:54 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77 1073741824" returned: 0 in 1.355s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:54 devstack sudo[98098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77
Jul 04 00:01:54 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:54 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-550dfa9e-4e47-4224-8d9c-6741a03d6ee9 tempest-VolumesTransfersV357Test-1831908778 None] Transfer volume completed successfully.
Jul 04 00:01:55 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77" returned: 0 in 0.694s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854299a4-b8d9-4c24-ab0b-5baa6e8218c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b76ffe-ec2c-429b-93a9-304731bcf852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:55 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Volume volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77 (1b586751-5ba1-4b59-abd7-b1551a7f4f77): created successfully
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b76ffe-ec2c-429b-93a9-304731bcf852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (ae396ccb-82e3-4174-86b9-5fa9bc84fc16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:55 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ffeb7e3f-a3f0-43c8-afbc-4a7b9b88a5f8 tempest-VolumesGetTest-1332725268 None] Created volume successfully.
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Acquiring lock "cinder-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Lock "cinder-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Acquiring lock "cinder-quobyte-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Lock "cinder-quobyte-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9" acquired by "delete_volume" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0a12cf-9d1a-4570-8c34-f54a244f46aa]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:56 devstack sudo[98120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9
Jul 04 00:01:56 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-1b586751-5ba1-4b59-abd7-b1551a7f4f77-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Lock "cinder-1b586751-5ba1-4b59-abd7-b1551a7f4f77-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-quobyte-1b586751-5ba1-4b59-abd7-b1551a7f4f77" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:56 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-1b586751-5ba1-4b59-abd7-b1551a7f4f77" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:56 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[02052a22-fbf4-430e-b2a5-fadde0ec74d0]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:56 devstack sudo[98124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77
Jul 04 00:01:56 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:57 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9" returned: 0 in 1.032s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:57 devstack sudo[98129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9
Jul 04 00:01:57 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:57 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77" returned: 0 in 0.990s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:57 devstack sudo[98134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77
Jul 04 00:01:57 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:57 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9" returned: 0 in 0.765s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Lock "cinder-quobyte-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9" released by "delete_volume" :: held 1.857s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Created reservations ['95a53b65-a5f2-4492-8069-e8925929559a', '3f085af1-eabe-49d7-8ad0-d16c04630a11', '2b994491-6c1c-4b49-8ff0-f4f35323a6c9', 'ad0c5922-a640-474f-848c-94c1485ac6ee'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:58 devstack sudo[98137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:01:58 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:58 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1b586751-5ba1-4b59-abd7-b1551a7f4f77" returned: 0 in 0.785s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-1b586751-5ba1-4b59-abd7-b1551a7f4f77" released by "delete_volume" :: held 1.844s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:58 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Created reservations ['f723c55c-a7d3-4b44-9379-875efddbfb42', '07f4f301-acf8-4252-b89b-94bf0ed84c2b', 'a93b162e-fa16-453a-a35b-842e5758a6f9', '014b988b-d5bf-4c54-887a-30529dab3d0c'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:58 devstack sudo[98140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:01:58 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-4f04e8e3-0ad1-4450-b353-f43662aee3ed-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Lock "cinder-4f04e8e3-0ad1-4450-b353-f43662aee3ed-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:59 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.068s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-quobyte-4f04e8e3-0ad1-4450-b353-f43662aee3ed" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:59 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Deleted volume successfully.
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-4f04e8e3-0ad1-4450-b353-f43662aee3ed" acquired by "delete_volume" :: waited 0.060s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5f78ce22-e67a-4ed1-b237-9a811dc1bd33 tempest-VolumesTransfersV357Test-615902780 None] Lock "cinder-d8c1f77a-c4d4-430a-94a5-8aa3c411b8c9-delete_volume" released by "delete_volume" :: held 3.286s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7d5cc5-a040-4d50-8e7b-397d68943e76]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:59 devstack sudo[98143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed
Jul 04 00:01:59 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Flow 'volume_create_manager' (a2607317-aa41-405d-8c29-755c7f4fb72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47f736c-bd3d-4cb3-b2e7-9b4f30f0439a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47f736c-bd3d-4cb3-b2e7-9b4f30f0439a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-713152876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f17722-3df5-4430-8aa9-c9b79ea7a4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f066b39efd46cb83ed76cc3aeb840b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:59Z,use_quota=True,user_id='2926c0bdda7547989bbbcfdae7a8b376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956d026f-250c-4a22-8043-476ce741912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956d026f-250c-4a22-8043-476ce741912b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5e4a8b-a820-4886-bb6b-fd703adaf7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5e4a8b-a820-4886-bb6b-fd703adaf7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f17722-3df5-4430-8aa9-c9b79ea7a4d2', 'volume_name': 'volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f3f253-d7b4-49c0-a27d-391df81553be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f3f253-d7b4-49c0-a27d-391df81553be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9641aad7-b1ad-49ab-9ef6-03354f6b02df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:59 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Volume d6f17722-3df5-4430-8aa9-c9b79ea7a4d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2', 'volume_size': 1}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-713152876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f17722-3df5-4430-8aa9-c9b79ea7a4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f066b39efd46cb83ed76cc3aeb840b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:59Z,use_quota=True,user_id='2926c0bdda7547989bbbcfdae7a8b376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Creating volume d6f17722-3df5-4430-8aa9-c9b79ea7a4d2 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:59 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:59 devstack sudo[98146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2 1073741824
Jul 04 00:01:59 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:59 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.206s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:59 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Deleted volume successfully.
Jul 04 00:01:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0d92dbd8-8959-4cab-a000-ec272ce218fb tempest-VolumesGetTest-1332725268 None] Lock "cinder-1b586751-5ba1-4b59-abd7-b1551a7f4f77-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:00 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed" returned: 0 in 0.953s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:00 devstack sudo[98152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed
Jul 04 00:02:00 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Flow 'volume_create_manager' (09921706-8c47-4618-adbf-3c155f7bb6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152bd858-e121-4211-8300-48bdcbd0d188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152bd858-e121-4211-8300-48bdcbd0d188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1692316592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0996db0d-045a-456d-a8a9-85ace03ac577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4f54a14724b749771dc07ea7ba11d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:01Z,use_quota=True,user_id='b887c1f6f23048d68f27e72fdb718741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82e0308-0d20-4999-aaaf-77fa6643aec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d82e0308-0d20-4999-aaaf-77fa6643aec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:00 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a1bb55-2875-47e5-8f0a-a6829a7b10d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a1bb55-2875-47e5-8f0a-a6829a7b10d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0996db0d-045a-456d-a8a9-85ace03ac577', 'volume_name': 'volume-0996db0d-045a-456d-a8a9-85ace03ac577', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0211728-12f8-4051-a648-de5bfa352ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0211728-12f8-4051-a648-de5bfa352ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f18c22-df7c-487d-a98b-e678af063205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:00 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Volume 0996db0d-045a-456d-a8a9-85ace03ac577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0996db0d-045a-456d-a8a9-85ace03ac577', 'volume_size': 1}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2 1073741824" returned: 0 in 1.204s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:00 devstack sudo[98159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2
Jul 04 00:02:00 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:00 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4f04e8e3-0ad1-4450-b353-f43662aee3ed" returned: 0 in 0.729s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-4f04e8e3-0ad1-4450-b353-f43662aee3ed" released by "delete_volume" :: held 1.772s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:00 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Created reservations ['3bc6256b-2de0-488b-8d0f-20d5b7351bce', 'f49c7734-5e9a-45f5-8e62-0f2b955aa9ad', 'fdbb7eb0-b1fe-4042-bc7b-dfc2ba2d04ee', '7b7db3d4-1cac-4d9c-b253-039c634f0235'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:01 devstack sudo[98162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:02:01 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-a19d4ede-e9ff-4273-a8f4-b656f88cc781-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:01 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2" returned: 0 in 0.811s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Lock "cinder-a19d4ede-e9ff-4273-a8f4-b656f88cc781-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.864s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1692316592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0996db0d-045a-456d-a8a9-85ace03ac577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b4f54a14724b749771dc07ea7ba11d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:01Z,use_quota=True,user_id='b887c1f6f23048d68f27e72fdb718741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Creating volume 0996db0d-045a-456d-a8a9-85ace03ac577 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:01 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:01 devstack sudo[98165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577 1073741824
Jul 04 00:02:01 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9641aad7-b1ad-49ab-9ef6-03354f6b02df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da7972a-692a-42ff-8fc6-943ab5dc19a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:01 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Volume volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2 (d6f17722-3df5-4430-8aa9-c9b79ea7a4d2): created successfully
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4da7972a-692a-42ff-8fc6-943ab5dc19a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Flow 'volume_create_manager' (a2607317-aa41-405d-8c29-755c7f4fb72f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-quobyte-a19d4ede-e9ff-4273-a8f4-b656f88cc781" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:01 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c98c7a85-c6a5-419f-96e8-cf1f7007ee43 tempest-VolumesTransfersV357Test-328185926 None] Created volume successfully.
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-a19d4ede-e9ff-4273-a8f4-b656f88cc781" acquired by "delete_volume" :: waited 0.047s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b0dce7-606f-4b0d-a22a-d501f3ee9d5e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:01 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.836s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:01 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Deleted volume successfully.
Jul 04 00:02:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-40439497-77d6-48a1-b2a6-4769b7c2e757 tempest-VolumesGetTest-1332725268 None] Lock "cinder-4f04e8e3-0ad1-4450-b353-f43662aee3ed-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:01 devstack sudo[98168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781
Jul 04 00:02:01 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:02 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577 1073741824" returned: 0 in 1.069s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:02 devstack sudo[98177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577
Jul 04 00:02:02 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:02 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781" returned: 0 in 1.037s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:02 devstack sudo[98179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781
Jul 04 00:02:02 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Acquiring lock "cinder-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Lock "cinder-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Acquiring lock "cinder-quobyte-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Lock "cinder-quobyte-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f427293-2bdc-4a25-b2c7-9f87387e839d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:03 devstack sudo[98182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2
Jul 04 00:02:03 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:03 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577" returned: 0 in 0.821s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84f18c22-df7c-487d-a98b-e678af063205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0996db0d-045a-456d-a8a9-85ace03ac577', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9450ef75-44cb-4280-8a2c-6889c3e1b866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:03 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Volume volume-0996db0d-045a-456d-a8a9-85ace03ac577 (0996db0d-045a-456d-a8a9-85ace03ac577): created successfully
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9450ef75-44cb-4280-8a2c-6889c3e1b866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Flow 'volume_create_manager' (09921706-8c47-4618-adbf-3c155f7bb6bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:03 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8e9c7138-6c0b-454a-9fcb-b6c1655a042d tempest-TestMinimumBasicScenario-1371945570 None] Created volume successfully.
Jul 04 00:02:03 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a19d4ede-e9ff-4273-a8f4-b656f88cc781" returned: 0 in 0.841s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-a19d4ede-e9ff-4273-a8f4-b656f88cc781" released by "delete_volume" :: held 1.968s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Created reservations ['7c0cb01a-bbc0-46a9-af1f-95f57c3d67a3', 'de8be324-10f1-44ee-94e1-e015e5e7a8dc', '8aab5f8b-66c6-45bf-876a-08291a448637', 'ca465349-7bcd-4b97-aa65-a4e7a747e33f'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:03 devstack sudo[98186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:02:03 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:04 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2" returned: 0 in 1.053s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:04 devstack sudo[98195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2
Jul 04 00:02:04 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:04 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.763s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:04 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:04 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Deleted volume successfully.
Jul 04 00:02:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-257703ac-e6d8-4ef7-adc1-ca9824ce8ea7 tempest-VolumesGetTest-1332725268 None] Lock "cinder-a19d4ede-e9ff-4273-a8f4-b656f88cc781-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:04 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2" returned: 0 in 0.697s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Lock "cinder-quobyte-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2" released by "delete_volume" :: held 1.799s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:04 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Created reservations ['f93c421a-8236-4503-899b-c66c784cf589', '3f551512-7214-4806-a284-5e582a0f1d3c', '62226763-5295-4b80-9eb6-d0a88e4da860', 'f4703069-450c-4690-814a-c1549661dd5e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:05 devstack sudo[98199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:02:05 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:05 devstack sudo[98201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:02:05 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:05 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.845s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:02:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:02:06 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (6c41e012-db04-4062-8913-6e538d031de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1064e937-af8e-4477-b016-a000e69670be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1064e937-af8e-4477-b016-a000e69670be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-115038839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5f484b-b982-441a-865b-3c348f9bd621,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:06Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d32646-95a6-4339-b36e-14c87d21b5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d32646-95a6-4339-b36e-14c87d21b5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d13a59-bb81-4b99-9b9b-c3c7e0c7907c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:06 devstack cinder-volume[86648]: DEBUG cinder.image.glance [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Creating Keystone auth plugin from conf {{(pid=86648) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 04 00:02:06 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.146s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:06 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:06 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Deleted volume successfully.
Jul 04 00:02:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-46de2762-fa89-4b0e-8a03-816b5be523d0 tempest-VolumesTransfersV357Test-615902780 None] Lock "cinder-d6f17722-3df5-4430-8aa9-c9b79ea7a4d2-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d13a59-bb81-4b99-9b9b-c3c7e0c7907c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f5f484b-b982-441a-865b-3c348f9bd621', 'volume_name': 'volume-5f5f484b-b982-441a-865b-3c348f9bd621', 'volume_size': 1, 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c411eeda2924759a25bfc54b8e705a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d224893d0>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06d799d-258b-4a2a-a29d-57bbc8441de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06d799d-258b-4a2a-a29d-57bbc8441de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55407db3-604c-4221-a61c-21defca05718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:07 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Volume 5f5f484b-b982-441a-865b-3c348f9bd621: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f5f484b-b982-441a-865b-3c348f9bd621', 'volume_size': 1, 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c411eeda2924759a25bfc54b8e705a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d224893d0>}
Jul 04 00:02:07 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Trying to clone 5f5f484b-b982-441a-865b-3c348f9bd621 from image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]). {{(pid=86648) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 04 00:02:07 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 04 00:02:07 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Image download 20.69 MB at 20.69 MB/s
Jul 04 00:02:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed045c8-bb7c-478d-bc42-c426a1edcfe7]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-a0339610-30ac-4fda-b6e5-80f8ad61fb8f req-ae7e009b-3e91-432b-8018-a6cf7deb4538 tempest-TestMinimumBasicScenario-1371945570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-a0339610-30ac-4fda-b6e5-80f8ad61fb8f req-ae7e009b-3e91-432b-8018-a6cf7deb4538 tempest-TestMinimumBasicScenario-1371945570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[260ee05f-4013-4838-991d-f4aa3dda2de3]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-a0339610-30ac-4fda-b6e5-80f8ad61fb8f req-ae7e009b-3e91-432b-8018-a6cf7deb4538 tempest-TestMinimumBasicScenario-1371945570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:07 devstack sudo[98216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD
Jul 04 00:02:07 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:08 devstack sudo[98218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577
Jul 04 00:02:08 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:08 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-a0339610-30ac-4fda-b6e5-80f8ad61fb8f req-ae7e009b-3e91-432b-8018-a6cf7deb4538 tempest-TestMinimumBasicScenario-1371945570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577" returned: 0 in 1.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-a0339610-30ac-4fda-b6e5-80f8ad61fb8f req-ae7e009b-3e91-432b-8018-a6cf7deb4538 tempest-TestMinimumBasicScenario-1371945570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.056s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:08 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-a0339610-30ac-4fda-b6e5-80f8ad61fb8f req-ae7e009b-3e91-432b-8018-a6cf7deb4538 tempest-TestMinimumBasicScenario-1371945570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-0996db0d-045a-456d-a8a9-85ace03ac577', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2627cd53-ca88-4edb-b8bf-29768f062d8d', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:02:09 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD" returned: 0 in 1.221s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Temporary image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc is fetched for user d309ed6e990d4d8591cf045b423f05f4. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 04 00:02:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-a0339610-30ac-4fda-b6e5-80f8ad61fb8f req-ae7e009b-3e91-432b-8018-a6cf7deb4538 tempest-TestMinimumBasicScenario-1371945570 None] attachment_update completed successfully.
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2897b9-0b43-4890-8312-ad27dc6392a6]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:09 devstack sudo[98266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD
Jul 04 00:02:09 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:09 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-115038839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5f484b-b982-441a-865b-3c348f9bd621,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:06Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Creating volume 5f5f484b-b982-441a-865b-3c348f9bd621 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:09 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:02:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:09 devstack sudo[98338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 1073741824
Jul 04 00:02:09 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:10 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 1073741824" returned: 0 in 1.082s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:11 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621
Jul 04 00:02:11 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:11 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621" returned: 0 in 0.754s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:11 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Attempting download of 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc ((None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}])) to volume 5f5f484b-b982-441a-865b-3c348f9bd621. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 04 00:02:11 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[828cfbcc-5eb3-4bcd-adb5-07c31120f546]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_ohh5ilk9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:12 devstack sudo[98699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_ohh5ilk9
Jul 04 00:02:12 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:12 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_ohh5ilk9" returned: 0 in 0.754s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_ohh5ilk9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:12 devstack sudo[98703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_ohh5ilk9
Jul 04 00:02:12 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:13 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_ohh5ilk9" returned: 1 in 0.808s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_ohh5ilk9' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[733df827-f644-4d80-8ae5-e132fd9ed213]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:13 devstack sudo[98707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD
Jul 04 00:02:13 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:INSERT=23,cinder:UPDATE=103,cinder:SELECT=77,cinder:DELETE=9 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=72,cinder:INSERT=26,cinder:UPDATE=107,cinder:DELETE=10 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Flow 'volume_create_manager' (10d833d2-cdd2-4c9d-b39d-b7fd712c979d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5731aeb-8b10-4872-9e4f-c2c270ed8bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5731aeb-8b10-4872-9e4f-c2c270ed8bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-317197228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38625475-efe6-491d-b8c1-fff545b0a3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec34458c392d437b9453d7c4b066e9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:14Z,use_quota=True,user_id='5a742ae666564e69b42b2ac7abb0a76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f560f84-cd16-4ffd-88d6-4833b0b83ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f560f84-cd16-4ffd-88d6-4833b0b83ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34218950-ba08-4697-96e0-acbf79a5dac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:13 devstack cinder-volume[86648]: DEBUG cinder.image.glance [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Creating Keystone auth plugin from conf {{(pid=86648) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 04 00:02:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34218950-ba08-4697-96e0-acbf79a5dac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38625475-efe6-491d-b8c1-fff545b0a3c9', 'volume_name': 'volume-38625475-efe6-491d-b8c1-fff545b0a3c9', 'volume_size': 1, 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c411eeda2924759a25bfc54b8e705a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2ca8a570>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238e9865-fd8d-4887-b6cd-4e03fb292ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238e9865-fd8d-4887-b6cd-4e03fb292ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d025dae-d5e0-49c2-b497-9fb2aa31303c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:14 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Volume 38625475-efe6-491d-b8c1-fff545b0a3c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38625475-efe6-491d-b8c1-fff545b0a3c9', 'volume_size': 1, 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c411eeda2924759a25bfc54b8e705a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2ca8a570>}
Jul 04 00:02:14 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Trying to clone 38625475-efe6-491d-b8c1-fff545b0a3c9 from image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]). {{(pid=86648) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 04 00:02:14 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD" returned: 0 in 1.068s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:14 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc was qcow2, converting to raw {{(pid=86648) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 04 00:02:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:14 devstack sudo[98713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621
Jul 04 00:02:14 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:14 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 04 00:02:14 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Image download 20.69 MB at 20.69 MB/s
Jul 04 00:02:14 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6334ac1-db00-488c-82df-78d768c23d4e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:14 devstack sudo[98716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD
Jul 04 00:02:14 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:15 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD" returned: 0 in 0.920s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:15 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Temporary image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc is fetched for user 5a742ae666564e69b42b2ac7abb0a76e. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 04 00:02:15 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff9d50e-09e8-4acc-a4a4-9edb15d51dc8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:15 devstack sudo[98731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD
Jul 04 00:02:15 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:16 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD" returned: 0 in 0.780s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-317197228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38625475-efe6-491d-b8c1-fff545b0a3c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec34458c392d437b9453d7c4b066e9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:14Z,use_quota=True,user_id='5a742ae666564e69b42b2ac7abb0a76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Creating volume 38625475-efe6-491d-b8c1-fff545b0a3c9 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:16 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:02:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:16 devstack sudo[98737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 1073741824
Jul 04 00:02:16 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:17 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621" returned: 0 in 2.672s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:17 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_xb0c497bdevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:02:17 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Converted 112.00 MB image at 41.90 MB/s
Jul 04 00:02:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:17 devstack sudo[98740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 1G
Jul 04 00:02:17 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:17 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 1073741824" returned: 0 in 1.076s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:17 devstack sudo[98748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9
Jul 04 00:02:17 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:18 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 1G" returned: 0 in 0.851s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:18 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8529159-3eb4-45ee-8d29-5862679bbb80]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:18 devstack sudo[98754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621
Jul 04 00:02:18 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:18 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9" returned: 0 in 0.802s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:18 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Attempting download of 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc ((None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}])) to volume 38625475-efe6-491d-b8c1-fff545b0a3c9. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 04 00:02:18 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ba32af-4de8-4a26-afe1-99a897de9867]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_y1sx2as7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:18 devstack sudo[98757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_y1sx2as7
Jul 04 00:02:18 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:19 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621" returned: 0 in 0.932s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:19 devstack sudo[98761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621
Jul 04 00:02:19 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:19 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_y1sx2as7" returned: 0 in 0.865s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_y1sx2as7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:19 devstack sudo[98765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_y1sx2as7
Jul 04 00:02:19 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:19 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621" returned: 1 in 0.874s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:02:19 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Downloaded image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc ((None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}])) to volume 5f5f484b-b982-441a-865b-3c348f9bd621 successfully. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 04 00:02:19 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Temporary image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc for user d309ed6e990d4d8591cf045b423f05f4 is deleted. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 04 00:02:19 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Marking volume 5f5f484b-b982-441a-865b-3c348f9bd621 as bootable. {{(pid=86648) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 04 00:02:19 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Copying metadata from image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc to 5f5f484b-b982-441a-865b-3c348f9bd621. {{(pid=86648) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 04 00:02:19 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Creating volume glance metadata for volume 5f5f484b-b982-441a-865b-3c348f9bd621 backed by image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86648) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 04 00:02:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55407db3-604c-4221-a61c-21defca05718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5f484b-b982-441a-865b-3c348f9bd621', 'volume_size': 1, 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c411eeda2924759a25bfc54b8e705a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d224893d0>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5096c8-bf25-484f-8b6f-79e8e91cd3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:20 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Volume volume-5f5f484b-b982-441a-865b-3c348f9bd621 (5f5f484b-b982-441a-865b-3c348f9bd621): created successfully
Jul 04 00:02:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5096c8-bf25-484f-8b6f-79e8e91cd3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (6c41e012-db04-4062-8913-6e538d031de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:20 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b2ee6e0f-523a-452d-bb14-d9a1ffabc110 tempest-VolumesGetTest-1332725268 None] Created volume successfully.
Jul 04 00:02:20 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_y1sx2as7" returned: 1 in 0.871s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_y1sx2as7' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:02:20 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fc11ff-abb5-4053-8bf4-fc3fbdf117f6]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:20 devstack sudo[98772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD
Jul 04 00:02:20 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:21 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:21 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc was qcow2, converting to raw {{(pid=86648) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 04 00:02:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:21 devstack sudo[98778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9
Jul 04 00:02:21 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (4f64658e-6542-4d36-bb46-6903aac69867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270fde20-5160-4811-8cd0-6b420ef207ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (270fde20-5160-4811-8cd0-6b420ef207ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1939073945',display_name='tempest-VolumesGetTest-Volume-1447222387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0285a25b-1e00-4088-a710-bfdf1f23cacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:22Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cccc38fe-374e-44dc-baee-694371f4a6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cccc38fe-374e-44dc-baee-694371f4a6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de0f3ea-8fa2-4623-afed-8fb8b374c995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de0f3ea-8fa2-4623-afed-8fb8b374c995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0285a25b-1e00-4088-a710-bfdf1f23cacb', 'volume_name': 'volume-0285a25b-1e00-4088-a710-bfdf1f23cacb', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f028b8-20a2-406f-b7a4-899e64d7cce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f028b8-20a2-406f-b7a4-899e64d7cce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7ba5ad-6c91-4814-ab82-f124e517adda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:22 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Volume 0285a25b-1e00-4088-a710-bfdf1f23cacb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0285a25b-1e00-4088-a710-bfdf1f23cacb', 'volume_size': 1}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1939073945',display_name='tempest-VolumesGetTest-Volume-1447222387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0285a25b-1e00-4088-a710-bfdf1f23cacb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d639f9b80106454caddce1d30671e5ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:22Z,use_quota=True,user_id='d309ed6e990d4d8591cf045b423f05f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Creating volume 0285a25b-1e00-4088-a710-bfdf1f23cacb {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:22 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:02:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0285a25b-1e00-4088-a710-bfdf1f23cacb 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:22 devstack sudo[98788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0285a25b-1e00-4088-a710-bfdf1f23cacb 1073741824
Jul 04 00:02:22 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:23 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0285a25b-1e00-4088-a710-bfdf1f23cacb 1073741824" returned: 0 in 0.971s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0285a25b-1e00-4088-a710-bfdf1f23cacb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:23 devstack sudo[98795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0285a25b-1e00-4088-a710-bfdf1f23cacb
Jul 04 00:02:23 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:23 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9" returned: 0 in 2.210s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:23 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_sp9i758ldevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:02:23 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Converted 112.00 MB image at 50.65 MB/s
Jul 04 00:02:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:23 devstack sudo[98797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 1G
Jul 04 00:02:23 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:23 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0285a25b-1e00-4088-a710-bfdf1f23cacb" returned: 0 in 0.698s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7ba5ad-6c91-4814-ab82-f124e517adda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0285a25b-1e00-4088-a710-bfdf1f23cacb', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602255c2-5f3f-42ec-b2cb-dab26ae8b74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:23 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Volume volume-0285a25b-1e00-4088-a710-bfdf1f23cacb (0285a25b-1e00-4088-a710-bfdf1f23cacb): created successfully
Jul 04 00:02:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602255c2-5f3f-42ec-b2cb-dab26ae8b74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Flow 'volume_create_manager' (4f64658e-6542-4d36-bb46-6903aac69867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:23 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1997f0fc-a1fe-42e1-9a10-f66f34c50e88 tempest-VolumesGetTest-1332725268 None] Created volume successfully.
Jul 04 00:02:24 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 1G" returned: 0 in 0.727s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:24 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[86aaa06f-c439-47bf-bab7-cfe7938bc070]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:24 devstack sudo[98803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9
Jul 04 00:02:24 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-0285a25b-1e00-4088-a710-bfdf1f23cacb-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Lock "cinder-0285a25b-1e00-4088-a710-bfdf1f23cacb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-quobyte-0285a25b-1e00-4088-a710-bfdf1f23cacb" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-0285a25b-1e00-4088-a710-bfdf1f23cacb" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:24 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5624313-8dd4-4e15-9238-f26952301e65]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0285a25b-1e00-4088-a710-bfdf1f23cacb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:24 devstack sudo[98805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0285a25b-1e00-4088-a710-bfdf1f23cacb
Jul 04 00:02:24 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:24 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9" returned: 0 in 0.805s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:25 devstack sudo[98815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9
Jul 04 00:02:25 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:25 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0285a25b-1e00-4088-a710-bfdf1f23cacb" returned: 0 in 0.829s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0285a25b-1e00-4088-a710-bfdf1f23cacb {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:25 devstack sudo[98821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0285a25b-1e00-4088-a710-bfdf1f23cacb
Jul 04 00:02:25 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:25 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9" returned: 1 in 0.813s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Downloaded image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc ((None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}])) to volume 38625475-efe6-491d-b8c1-fff545b0a3c9 successfully. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Temporary image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc for user 5a742ae666564e69b42b2ac7abb0a76e is deleted. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Marking volume 38625475-efe6-491d-b8c1-fff545b0a3c9 as bootable. {{(pid=86648) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Copying metadata from image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc to 38625475-efe6-491d-b8c1-fff545b0a3c9. {{(pid=86648) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Creating volume glance metadata for volume 38625475-efe6-491d-b8c1-fff545b0a3c9 backed by image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86648) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d025dae-d5e0-49c2-b497-9fb2aa31303c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38625475-efe6-491d-b8c1-fff545b0a3c9', 'volume_size': 1, 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c411eeda2924759a25bfc54b8e705a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2ca8a570>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f66ed44-ee81-4333-8fc9-bfc751709b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:25 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Volume volume-38625475-efe6-491d-b8c1-fff545b0a3c9 (38625475-efe6-491d-b8c1-fff545b0a3c9): created successfully
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f66ed44-ee81-4333-8fc9-bfc751709b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:25 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Flow 'volume_create_manager' (10d833d2-cdd2-4c9d-b39d-b7fd712c979d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0285a25b-1e00-4088-a710-bfdf1f23cacb" returned: 0 in 0.728s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-0285a25b-1e00-4088-a710-bfdf1f23cacb" released by "delete_volume" :: held 1.603s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:25 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e9d1d02c-acdf-45fc-b6e5-cb3f14283626 tempest-VolumesExtendTest-1394185665 None] Created volume successfully.
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Created reservations ['46225388-3e9a-45ba-a63a-174b33384b11', '86d43f2f-69ad-4b4b-b8bc-0b2f61ed23a4', '54f40bad-a323-4344-9c65-9c23afe5b3df', 'e8d5be41-afc9-4e6c-a82b-ea2160fa5987'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:26 devstack sudo[98827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:02:26 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-5f5f484b-b982-441a-865b-3c348f9bd621-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Lock "cinder-5f5f484b-b982-441a-865b-3c348f9bd621-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Acquiring lock "cinder-quobyte-5f5f484b-b982-441a-865b-3c348f9bd621" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-5f5f484b-b982-441a-865b-3c348f9bd621" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[130b6435-4439-463a-9115-e8d6d182f054]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:26 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.659s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:26 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Deleted volume successfully.
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b25a4368-7c33-4c93-b774-954b9e2d4659 tempest-VolumesGetTest-1332725268 None] Lock "cinder-0285a25b-1e00-4088-a710-bfdf1f23cacb-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:26 devstack sudo[98830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621
Jul 04 00:02:26 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-570b3d9f-a419-4643-995f-53ad77c8257c tempest-VolumesExtendTest-1394185665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-570b3d9f-a419-4643-995f-53ad77c8257c tempest-VolumesExtendTest-1394185665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fd02ae-30c7-452e-9ba0-5df3b7c3f8b8]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-570b3d9f-a419-4643-995f-53ad77c8257c tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:27 devstack sudo[98832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9
Jul 04 00:02:27 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:27 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621" returned: 0 in 0.776s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:27 devstack sudo[98836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621
Jul 04 00:02:27 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:27 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-570b3d9f-a419-4643-995f-53ad77c8257c tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9" returned: 0 in 0.814s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-570b3d9f-a419-4643-995f-53ad77c8257c tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:27 devstack sudo[98840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9
Jul 04 00:02:27 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:28 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621" returned: 1 in 0.739s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:28 devstack sudo[98845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621
Jul 04 00:02:28 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:28 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-570b3d9f-a419-4643-995f-53ad77c8257c tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9" returned: 1 in 0.758s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-570b3d9f-a419-4643-995f-53ad77c8257c tempest-VolumesExtendTest-1394185665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-570b3d9f-a419-4643-995f-53ad77c8257c tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 2G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-570b3d9f-a419-4643-995f-53ad77c8257c tempest-VolumesExtendTest-1394185665 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 2G" returned: 0 in 0.057s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-570b3d9f-a419-4643-995f-53ad77c8257c tempest-VolumesExtendTest-1394185665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.673s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:28 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-570b3d9f-a419-4643-995f-53ad77c8257c tempest-VolumesExtendTest-1394185665 None] Extend volume completed successfully.
Jul 04 00:02:28 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5f5f484b-b982-441a-865b-3c348f9bd621" returned: 0 in 0.638s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Lock "cinder-quobyte-5f5f484b-b982-441a-865b-3c348f9bd621" released by "delete_volume" :: held 2.220s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Created reservations ['8f4e3487-20c4-4e28-bf69-7df6e066f57b', 'f45b1a9b-c793-40ad-ae88-19ab6ab4dadf', '5dd637e1-1dfd-4a2a-856f-1d2c3e5adc7a', '3b19a56e-1143-42c5-9c78-524c9d905887'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:28 devstack sudo[98854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:02:28 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:29 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Acquiring lock "cinder-38625475-efe6-491d-b8c1-fff545b0a3c9-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:29 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Lock "cinder-38625475-efe6-491d-b8c1-fff545b0a3c9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:29 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Acquiring lock "cinder-quobyte-38625475-efe6-491d-b8c1-fff545b0a3c9" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:29 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Lock "cinder-quobyte-38625475-efe6-491d-b8c1-fff545b0a3c9" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:29 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3a6101-2dce-4fb8-a389-dc085ce63e26]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:29 devstack sudo[98856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9
Jul 04 00:02:29 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:29 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.667s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:29 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:29 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Deleted volume successfully.
Jul 04 00:02:29 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-06e0611b-7c81-4410-ae35-ce7c16a46a1e tempest-VolumesGetTest-1332725268 None] Lock "cinder-5f5f484b-b982-441a-865b-3c348f9bd621-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:30 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9" returned: 0 in 0.871s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:30 devstack sudo[98885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9
Jul 04 00:02:30 devstack sudo[98885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:31 devstack sudo[98885]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9" returned: 1 in 0.885s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:02:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:31 devstack sudo[98892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9
Jul 04 00:02:31 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:31 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38625475-efe6-491d-b8c1-fff545b0a3c9" returned: 0 in 0.668s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Lock "cinder-quobyte-38625475-efe6-491d-b8c1-fff545b0a3c9" released by "delete_volume" :: held 2.494s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:31 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Created reservations ['1d2fa8ae-4666-4412-b9a5-7ea47a64803c', 'c8f1cc74-3715-49f9-af9f-178554a650fd', 'a27b685e-8eb8-425f-a2e8-c5d7e3f82ecc', 'ebf0b8c4-9775-4032-b85a-5befdd751375'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:32 devstack sudo[98895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:02:32 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:32 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.723s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:32 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Deleted volume successfully.
Jul 04 00:02:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d817d8c6-3fa1-4291-b1a6-78b009836f08 tempest-VolumesExtendTest-1394185665 None] Lock "cinder-38625475-efe6-491d-b8c1-fff545b0a3c9-delete_volume" released by "delete_volume" :: held 3.451s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Flow 'volume_create_manager' (9b2b1bf8-34af-4f82-8add-44995addd989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65a2808-180c-4a31-82b2-93aeddc1b9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a65a2808-180c-4a31-82b2-93aeddc1b9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-589225385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a8869e-1eca-4e07-ab1c-9105702c154e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cccb5bc41549328395f65f03330d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:33Z,use_quota=True,user_id='ccb99092bc8747968f40234da72f7f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44eaa86-b6d8-4ec8-be7e-e6d89bfe1eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c44eaa86-b6d8-4ec8-be7e-e6d89bfe1eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45464a3-4b3f-4314-b7ca-d1db35fd0c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b45464a3-4b3f-4314-b7ca-d1db35fd0c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a8869e-1eca-4e07-ab1c-9105702c154e', 'volume_name': 'volume-f7a8869e-1eca-4e07-ab1c-9105702c154e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9355e4-b778-4d11-9951-e51cd137cad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9355e4-b778-4d11-9951-e51cd137cad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0b73a4-8542-48f1-a750-b3d65df2bec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:33 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Volume f7a8869e-1eca-4e07-ab1c-9105702c154e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a8869e-1eca-4e07-ab1c-9105702c154e', 'volume_size': 1}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-589225385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a8869e-1eca-4e07-ab1c-9105702c154e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59cccb5bc41549328395f65f03330d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:33Z,use_quota=True,user_id='ccb99092bc8747968f40234da72f7f6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Creating volume f7a8869e-1eca-4e07-ab1c-9105702c154e {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:33 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f7a8869e-1eca-4e07-ab1c-9105702c154e 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:33 devstack sudo[98924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f7a8869e-1eca-4e07-ab1c-9105702c154e 1073741824
Jul 04 00:02:33 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Flow 'volume_create_manager' (06b67c30-2950-4e47-8a72-822714c61dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b509b2-0be2-4af6-9048-267235b6b124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b509b2-0be2-4af6-9048-267235b6b124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-915269758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f1804c-f69c-44db-afe0-81b35c784479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec34458c392d437b9453d7c4b066e9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:33Z,use_quota=True,user_id='5a742ae666564e69b42b2ac7abb0a76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3069ec-6c51-4869-9bbf-6cfb324f77cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b3069ec-6c51-4869-9bbf-6cfb324f77cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3060a1-9d72-41a5-9ce0-c7c138cb0107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3060a1-9d72-41a5-9ce0-c7c138cb0107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f1804c-f69c-44db-afe0-81b35c784479', 'volume_name': 'volume-12f1804c-f69c-44db-afe0-81b35c784479', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16528b4-f725-40ad-b83f-747acfc0e5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16528b4-f725-40ad-b83f-747acfc0e5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c762df-78fc-4ed4-b00d-4a3619054bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:33 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Volume 12f1804c-f69c-44db-afe0-81b35c784479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f1804c-f69c-44db-afe0-81b35c784479', 'volume_size': 1}
Jul 04 00:02:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:34 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f7a8869e-1eca-4e07-ab1c-9105702c154e 1073741824" returned: 0 in 0.935s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f7a8869e-1eca-4e07-ab1c-9105702c154e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:34 devstack sudo[98932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f7a8869e-1eca-4e07-ab1c-9105702c154e
Jul 04 00:02:34 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:35 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f7a8869e-1eca-4e07-ab1c-9105702c154e" returned: 0 in 0.689s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.558s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-915269758',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f1804c-f69c-44db-afe0-81b35c784479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec34458c392d437b9453d7c4b066e9c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:33Z,use_quota=True,user_id='5a742ae666564e69b42b2ac7abb0a76e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Creating volume 12f1804c-f69c-44db-afe0-81b35c784479 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:35 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:35 devstack sudo[98936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479 1073741824
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0b73a4-8542-48f1-a750-b3d65df2bec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a8869e-1eca-4e07-ab1c-9105702c154e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:35 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb64fa68-744a-4eaa-b2ac-2714c163c3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:35 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Volume volume-f7a8869e-1eca-4e07-ab1c-9105702c154e (f7a8869e-1eca-4e07-ab1c-9105702c154e): created successfully
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb64fa68-744a-4eaa-b2ac-2714c163c3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Flow 'volume_create_manager' (9b2b1bf8-34af-4f82-8add-44995addd989) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:35 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e384ea7a-d2fa-4ab8-9dfe-780292b83298 tempest-VolumesNegativeTest-1574094753 None] Created volume successfully.
Jul 04 00:02:35 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479 1073741824" returned: 0 in 0.859s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:35 devstack sudo[98942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479
Jul 04 00:02:35 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:36 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479" returned: 0 in 0.713s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67c762df-78fc-4ed4-b00d-4a3619054bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f1804c-f69c-44db-afe0-81b35c784479', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1a7c8d-b9c4-4ac7-a9e7-0ca35d03205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:36 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Volume volume-12f1804c-f69c-44db-afe0-81b35c784479 (12f1804c-f69c-44db-afe0-81b35c784479): created successfully
Jul 04 00:02:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1a7c8d-b9c4-4ac7-a9e7-0ca35d03205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Flow 'volume_create_manager' (06b67c30-2950-4e47-8a72-822714c61dc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:36 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-268bf7e2-7858-49c2-97a3-f6bdec177fcc tempest-VolumesExtendTest-1394185665 None] Created volume successfully.
Jul 04 00:02:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] Creating offline snapshot 64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c of volume 12f1804c-f69c-44db-afe0-81b35c784479 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:02:37 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[659de43b-98cd-4092-baf6-a38ae90b7b6d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:37 devstack sudo[98953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479
Jul 04 00:02:37 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:38 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479" returned: 0 in 0.746s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:38 devstack sudo[98961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c 1G
Jul 04 00:02:38 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:39 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c 1G" returned: 0 in 0.850s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f1804c-f69c-44db-afe0-81b35c784479 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:39 devstack sudo[98966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f1804c-f69c-44db-afe0-81b35c784479 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c
Jul 04 00:02:39 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:40 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12f1804c-f69c-44db-afe0-81b35c784479 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c" returned: 0 in 0.694s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:40 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c is being set with open permissions: ugo+rw
Jul 04 00:02:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:40 devstack sudo[98971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c
Jul 04 00:02:40 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:40 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c" returned: 0 in 0.661s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:40 devstack sudo[98975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.info
Jul 04 00:02:40 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:41 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.info" returned: 0 in 0.663s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:41 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.info is being set with open permissions: ugo+rw
Jul 04 00:02:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:41 devstack sudo[98978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.info
Jul 04 00:02:41 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:42 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.info" returned: 0 in 0.671s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.408s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0629957f-5e08-4381-b26c-f06ebe4db7f1 tempest-VolumesExtendTest-1394185665 None] Create snapshot completed successfully
Jul 04 00:02:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-52d6bb77-9a34-4e0e-8793-a8f033451225 tempest-VolumesExtendTest-1394185665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-52d6bb77-9a34-4e0e-8793-a8f033451225 tempest-VolumesExtendTest-1394185665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:43 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5cbdf1-5e07-4e7b-baa2-fd1581254278]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-52d6bb77-9a34-4e0e-8793-a8f033451225 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:43 devstack sudo[98981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479
Jul 04 00:02:43 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:43 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-52d6bb77-9a34-4e0e-8793-a8f033451225 tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479" returned: 0 in 0.858s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-52d6bb77-9a34-4e0e-8793-a8f033451225 tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c 2G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-52d6bb77-9a34-4e0e-8793-a8f033451225 tempest-VolumesExtendTest-1394185665 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c 2G" returned: 0 in 0.231s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-52d6bb77-9a34-4e0e-8793-a8f033451225 tempest-VolumesExtendTest-1394185665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.141s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-52d6bb77-9a34-4e0e-8793-a8f033451225 tempest-VolumesExtendTest-1394185665 None] Extend volume completed successfully.
Jul 04 00:02:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Acquiring lock "cinder-64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Lock "cinder-64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Acquiring lock "cinder-quobyte-12f1804c-f69c-44db-afe0-81b35c784479" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Lock "cinder-quobyte-12f1804c-f69c-44db-afe0-81b35c784479" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Acquiring lock "cinder-quobyte-64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Lock "cinder-quobyte-64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Deleting offline snapshot 64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c of volume 12f1804c-f69c-44db-afe0-81b35c784479 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:02:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] snapshot_file for this snap is: volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:02:45 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5cb103-610a-42e9-8dbd-71ea68cb7a1c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:45 devstack sudo[98991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c
Jul 04 00:02:45 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:46 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c" returned: 0 in 1.085s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12f1804c-f69c-44db-afe0-81b35c784479(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:02:46 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4e6947-b382-4a99-bb7d-f9af06562cfe]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:46 devstack sudo[99021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479
Jul 04 00:02:46 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:47 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479" returned: 0 in 0.739s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:47 devstack sudo[99026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c
Jul 04 00:02:47 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:48 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c" returned: 0 in 0.731s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:48 devstack sudo[99031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c
Jul 04 00:02:48 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:48 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479.64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c" returned: 0 in 0.651s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Lock "cinder-quobyte-64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c" released by "_delete_snapshot" :: held 3.326s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Lock "cinder-quobyte-12f1804c-f69c-44db-afe0-81b35c784479" released by "delete_snapshot" :: held 3.361s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:48 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Created reservations ['70d14e9a-0d68-47e0-afc3-1e0aa28e065b', '0b523a44-a9db-40ac-9bef-f51d7f294462', '5072057e-80b1-4436-b7a0-ccfdb7ec2eaf', 'aa5a37d5-9050-40ca-b26d-fb6a71779feb'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Delete snapshot completed successfully.
Jul 04 00:02:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f58235c0-d1ae-4acd-8109-473a598e154d tempest-VolumesExtendTest-1394185665 None] Lock "cinder-64a2c6b3-5f9d-4d18-96d5-30f53c2ad82c-delete_snapshot" released by "delete_snapshot" :: held 3.516s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Acquiring lock "cinder-12f1804c-f69c-44db-afe0-81b35c784479-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Lock "cinder-12f1804c-f69c-44db-afe0-81b35c784479-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Acquiring lock "cinder-quobyte-12f1804c-f69c-44db-afe0-81b35c784479" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Lock "cinder-quobyte-12f1804c-f69c-44db-afe0-81b35c784479" acquired by "delete_volume" :: waited 0.040s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:49 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[934593e4-2021-48a3-8434-efc2b2925e7b]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:50 devstack sudo[99049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479
Jul 04 00:02:50 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:50 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479" returned: 0 in 0.932s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:50 devstack sudo[99086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479
Jul 04 00:02:50 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:51 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-12f1804c-f69c-44db-afe0-81b35c784479" returned: 0 in 0.654s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Lock "cinder-quobyte-12f1804c-f69c-44db-afe0-81b35c784479" released by "delete_volume" :: held 1.723s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:51 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Created reservations ['ae596c88-0dcc-4698-acde-16cf6d4e5b3d', '60ce42d1-afea-41a3-8a82-12b778409f28', 'ba0f28c1-67a9-4b79-b911-09f2c3d183f4', '6c069a15-9d59-4d84-be8c-549113188e32'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:51 devstack sudo[99108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:02:51 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:52 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.776s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:52 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:52 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Deleted volume successfully.
Jul 04 00:02:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f747a289-c6c1-4be3-bd66-e3059ef5214c tempest-VolumesExtendTest-1394185665 None] Lock "cinder-12f1804c-f69c-44db-afe0-81b35c784479-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Flow 'volume_create_manager' (f3be6351-ae73-40ae-b77c-342a9fb83100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4f3f4d-e48f-4cb1-a766-df7efa601b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f4f3f4d-e48f-4cb1-a766-df7efa601b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-364100518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957f28ba-3bc9-441c-a494-b72e2710f66c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e3419504e744777a24d9870594b7748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:56Z,use_quota=True,user_id='1bbb04ffbcd44103bee598a052767c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724cedf2-da0f-4fa1-9ec8-b6f0b459d04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724cedf2-da0f-4fa1-9ec8-b6f0b459d04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3851b165-fe26-4076-a727-9f3fbcef82f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3851b165-fe26-4076-a727-9f3fbcef82f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '957f28ba-3bc9-441c-a494-b72e2710f66c', 'volume_name': 'volume-957f28ba-3bc9-441c-a494-b72e2710f66c', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed6f4f8-a1e9-4f9a-a0ec-752e44e1463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ed6f4f8-a1e9-4f9a-a0ec-752e44e1463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57eea2bb-0ad0-4c85-9897-3d59622e6d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:55 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Volume 957f28ba-3bc9-441c-a494-b72e2710f66c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-957f28ba-3bc9-441c-a494-b72e2710f66c', 'volume_size': 1}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-364100518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957f28ba-3bc9-441c-a494-b72e2710f66c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e3419504e744777a24d9870594b7748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:56Z,use_quota=True,user_id='1bbb04ffbcd44103bee598a052767c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Creating volume 957f28ba-3bc9-441c-a494-b72e2710f66c {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:55 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:02:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-957f28ba-3bc9-441c-a494-b72e2710f66c 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:55 devstack sudo[99123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-957f28ba-3bc9-441c-a494-b72e2710f66c 1073741824
Jul 04 00:02:55 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:57 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-957f28ba-3bc9-441c-a494-b72e2710f66c 1073741824" returned: 0 in 1.194s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-957f28ba-3bc9-441c-a494-b72e2710f66c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:57 devstack sudo[99147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-957f28ba-3bc9-441c-a494-b72e2710f66c
Jul 04 00:02:57 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:58 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-957f28ba-3bc9-441c-a494-b72e2710f66c" returned: 0 in 0.868s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57eea2bb-0ad0-4c85-9897-3d59622e6d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957f28ba-3bc9-441c-a494-b72e2710f66c', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973f5260-d725-4ed6-a6ee-a35da9c9f1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:58 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Volume volume-957f28ba-3bc9-441c-a494-b72e2710f66c (957f28ba-3bc9-441c-a494-b72e2710f66c): created successfully
Jul 04 00:02:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973f5260-d725-4ed6-a6ee-a35da9c9f1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Flow 'volume_create_manager' (f3be6351-ae73-40ae-b77c-342a9fb83100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:58 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ad2a7cb2-3d03-4fb3-8559-08f80928e4ec tempest-VolumesListTestJSON-1146773030 None] Created volume successfully.
Jul 04 00:02:58 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-de478561-508c-41f3-97bf-5d11991d92fa req-e1961fc5-bb88-43a3-aae1-ebe71672c6f4 tempest-TestMinimumBasicScenario-1371945570 None] Terminate volume connection completed successfully.
Jul 04 00:02:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-de478561-508c-41f3-97bf-5d11991d92fa req-e1961fc5-bb88-43a3-aae1-ebe71672c6f4 tempest-TestMinimumBasicScenario-1371945570 None] Deleting attachment 2627cd53-ca88-4edb-b8bf-29768f062d8d. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Flow 'volume_create_manager' (50ce6ab6-7a79-4fbe-83bf-d82b9dafb8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df163e84-490f-4c81-b9f5-1a435c030655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df163e84-490f-4c81-b9f5-1a435c030655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1810538036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47025d6-06b6-4617-a0f1-138d10129b3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e3419504e744777a24d9870594b7748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:59Z,use_quota=True,user_id='1bbb04ffbcd44103bee598a052767c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85541b2-d4e6-4e13-b0bb-9434b91fc7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85541b2-d4e6-4e13-b0bb-9434b91fc7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1881c0-e49b-45d6-aab5-ea215f53e221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1881c0-e49b-45d6-aab5-ea215f53e221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a47025d6-06b6-4617-a0f1-138d10129b3e', 'volume_name': 'volume-a47025d6-06b6-4617-a0f1-138d10129b3e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8650e177-5767-4dc5-add8-92fe8fc0050e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8650e177-5767-4dc5-add8-92fe8fc0050e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2d9f94-f70c-4bf8-af87-6a7de1530f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:59 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Volume a47025d6-06b6-4617-a0f1-138d10129b3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a47025d6-06b6-4617-a0f1-138d10129b3e', 'volume_size': 1}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1810538036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a47025d6-06b6-4617-a0f1-138d10129b3e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e3419504e744777a24d9870594b7748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:59Z,use_quota=True,user_id='1bbb04ffbcd44103bee598a052767c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Creating volume a47025d6-06b6-4617-a0f1-138d10129b3e {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:59 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:02:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a47025d6-06b6-4617-a0f1-138d10129b3e 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:59 devstack sudo[99154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a47025d6-06b6-4617-a0f1-138d10129b3e 1073741824
Jul 04 00:02:59 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:00 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a47025d6-06b6-4617-a0f1-138d10129b3e 1073741824" returned: 0 in 0.841s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a47025d6-06b6-4617-a0f1-138d10129b3e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:00 devstack sudo[99161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a47025d6-06b6-4617-a0f1-138d10129b3e
Jul 04 00:03:00 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Acquiring lock "cinder-0996db0d-045a-456d-a8a9-85ace03ac577-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Lock "cinder-0996db0d-045a-456d-a8a9-85ace03ac577-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Acquiring lock "cinder-quobyte-0996db0d-045a-456d-a8a9-85ace03ac577" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Lock "cinder-quobyte-0996db0d-045a-456d-a8a9-85ace03ac577" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b24e75-6e4b-4aa2-9ffb-e3385b6bcf4a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:01 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a47025d6-06b6-4617-a0f1-138d10129b3e" returned: 0 in 0.662s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:01 devstack sudo[99164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577
Jul 04 00:03:01 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2d9f94-f70c-4bf8-af87-6a7de1530f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a47025d6-06b6-4617-a0f1-138d10129b3e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f06448-0869-4edc-924b-d97eefaeb92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:01 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Volume volume-a47025d6-06b6-4617-a0f1-138d10129b3e (a47025d6-06b6-4617-a0f1-138d10129b3e): created successfully
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f06448-0869-4edc-924b-d97eefaeb92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Flow 'volume_create_manager' (50ce6ab6-7a79-4fbe-83bf-d82b9dafb8b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:01 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1f8ad9e6-aae9-4e2d-bf9e-fc2bf767b86c tempest-VolumesListTestJSON-1146773030 None] Created volume successfully.
Jul 04 00:03:01 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577" returned: 0 in 0.854s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:01 devstack sudo[99169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577
Jul 04 00:03:01 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Flow 'volume_create_manager' (3726e808-19a3-44dd-b918-b5cf016c81e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7039329b-fa98-436b-8d9c-1033cfb31fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7039329b-fa98-436b-8d9c-1033cfb31fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1450654912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e3419504e744777a24d9870594b7748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:02Z,use_quota=True,user_id='1bbb04ffbcd44103bee598a052767c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182c9e2a-a97b-443c-82b7-d3a35f193c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (182c9e2a-a97b-443c-82b7-d3a35f193c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01543faa-1b24-4cb7-bf09-5a4ba84632b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01543faa-1b24-4cb7-bf09-5a4ba84632b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36', 'volume_name': 'volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b0301b-5007-42bf-9af0-abde5e4117e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b0301b-5007-42bf-9af0-abde5e4117e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b752897-1131-4829-993e-b84b3aed7ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:02 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Volume 2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36', 'volume_size': 1}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1450654912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e3419504e744777a24d9870594b7748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:02Z,use_quota=True,user_id='1bbb04ffbcd44103bee598a052767c97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Creating volume 2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:03:02 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:02 devstack sudo[99171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36 1073741824
Jul 04 00:03:02 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:02 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-0996db0d-045a-456d-a8a9-85ace03ac577" returned: 0 in 0.705s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Lock "cinder-quobyte-0996db0d-045a-456d-a8a9-85ace03ac577" released by "delete_volume" :: held 1.605s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Created reservations ['b4ba557c-4675-471f-90e6-165e73b22721', 'ad105cd6-ab06-4899-acdb-c23bdb357e94', '5ca39f79-5f81-4def-ab7c-5bf7abf7cfa6', 'ffd9782e-9a72-448a-94af-12db91edf70a'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:02 devstack sudo[99174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:03:02 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:03 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36 1073741824" returned: 0 in 1.028s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:03 devstack sudo[99181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36
Jul 04 00:03:03 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:03 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.771s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:03 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:03:03 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Deleted volume successfully.
Jul 04 00:03:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-bc9519b9-47fd-4acf-9d5a-1423ab82a492 tempest-TestMinimumBasicScenario-1371945570 None] Lock "cinder-0996db0d-045a-456d-a8a9-85ace03ac577-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:04 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36" returned: 0 in 0.751s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:04 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:03:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b752897-1131-4829-993e-b84b3aed7ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c190780f-c1df-418c-9b59-b55feced0088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:04 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Volume volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36 (2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36): created successfully
Jul 04 00:03:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c190780f-c1df-418c-9b59-b55feced0088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Flow 'volume_create_manager' (3726e808-19a3-44dd-b918-b5cf016c81e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:04 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-239d3566-29b0-4957-b150-e45ecc56ef43 tempest-VolumesListTestJSON-1146773030 None] Created volume successfully.
Jul 04 00:03:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:03:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:05 devstack sudo[99193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:03:05 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:06 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.149s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:06 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:03:06 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:03:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:03:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:03:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "cinder-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Lock "cinder-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "cinder-quobyte-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Lock "cinder-quobyte-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34291dc-993f-4d4f-84f8-16b91a30bae6]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:07 devstack sudo[99216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36
Jul 04 00:03:07 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:08 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36" returned: 0 in 0.830s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:08 devstack sudo[99221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36
Jul 04 00:03:08 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Acquiring lock "cinder-f7a8869e-1eca-4e07-ab1c-9105702c154e-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:08 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36" returned: 0 in 0.710s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Lock "cinder-f7a8869e-1eca-4e07-ab1c-9105702c154e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Lock "cinder-quobyte-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36" released by "delete_volume" :: held 1.599s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Acquiring lock "cinder-quobyte-f7a8869e-1eca-4e07-ab1c-9105702c154e" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Lock "cinder-quobyte-f7a8869e-1eca-4e07-ab1c-9105702c154e" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:08 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce9e07f-45e1-4d5a-a1ac-fe36d153f257]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f7a8869e-1eca-4e07-ab1c-9105702c154e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Created reservations ['113986ef-7281-461e-bea3-6b085ffb123c', 'bb3d5d7c-e945-447e-a2db-7ace877ba361', '6fcd512b-821e-4cef-a5a7-708dd9d8164a', '6af1b8f7-7632-4166-8e31-b191b2ca5247'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:03:09 devstack sudo[99224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f7a8869e-1eca-4e07-ab1c-9105702c154e
Jul 04 00:03:09 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:09 devstack sudo[99226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:03:09 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "cinder-a47025d6-06b6-4617-a0f1-138d10129b3e-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Lock "cinder-a47025d6-06b6-4617-a0f1-138d10129b3e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "cinder-quobyte-a47025d6-06b6-4617-a0f1-138d10129b3e" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Lock "cinder-quobyte-a47025d6-06b6-4617-a0f1-138d10129b3e" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[938683eb-b1de-4404-9799-1a1c1e35cc0c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a47025d6-06b6-4617-a0f1-138d10129b3e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:09 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:09 devstack sudo[99232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a47025d6-06b6-4617-a0f1-138d10129b3e
Jul 04 00:03:09 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f7a8869e-1eca-4e07-ab1c-9105702c154e" returned: 0 in 0.797s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f7a8869e-1eca-4e07-ab1c-9105702c154e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:09 devstack sudo[99235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f7a8869e-1eca-4e07-ab1c-9105702c154e
Jul 04 00:03:09 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:10 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.918s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:03:10 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Deleted volume successfully.
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d93b94e0-b379-4c74-ab2b-8ba4165650be tempest-VolumesListTestJSON-1146773030 None] Lock "cinder-2a2f7cf2-85e3-4fe5-b1fd-bbe4619f5c36-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:10 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a47025d6-06b6-4617-a0f1-138d10129b3e" returned: 0 in 0.938s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a47025d6-06b6-4617-a0f1-138d10129b3e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:10 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f7a8869e-1eca-4e07-ab1c-9105702c154e" returned: 0 in 0.833s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Lock "cinder-quobyte-f7a8869e-1eca-4e07-ab1c-9105702c154e" released by "delete_volume" :: held 1.681s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:10 devstack sudo[99242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a47025d6-06b6-4617-a0f1-138d10129b3e
Jul 04 00:03:10 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Created reservations ['042f7c32-e3a7-44cd-8362-96170bb92fa0', '27082ff5-4d7c-4350-a63c-e1918293ffb0', 'bf4b7979-8998-4208-8c6b-c78a5e48a391', 'a829e693-cea4-42a4-b408-a60f5206df9e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:10 devstack sudo[99244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:03:10 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:11 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a47025d6-06b6-4617-a0f1-138d10129b3e" returned: 0 in 0.860s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Lock "cinder-quobyte-a47025d6-06b6-4617-a0f1-138d10129b3e" released by "delete_volume" :: held 1.849s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:11 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:11 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Created reservations ['d0cdd837-a3c9-4b41-b8d6-e7630d1e9d6c', 'a361791d-a25b-4e11-a03f-978fd95fbae1', '3ca4eb77-28ad-48c0-8287-c017faa3323d', '602bd83c-cdf6-46b2-bc6e-dd5f89786491'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:03:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.814s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:11 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:03:11 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Deleted volume successfully.
Jul 04 00:03:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2e46f75f-d5bf-4016-9298-dbaf0ff3af78 tempest-VolumesNegativeTest-1574094753 None] Lock "cinder-f7a8869e-1eca-4e07-ab1c-9105702c154e-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:11 devstack sudo[99282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:03:11 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "cinder-957f28ba-3bc9-441c-a494-b72e2710f66c-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Lock "cinder-957f28ba-3bc9-441c-a494-b72e2710f66c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "cinder-quobyte-957f28ba-3bc9-441c-a494-b72e2710f66c" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Lock "cinder-quobyte-957f28ba-3bc9-441c-a494-b72e2710f66c" acquired by "delete_volume" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:12 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf1b833-9a24-4e82-a3ec-c39caae33713]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-957f28ba-3bc9-441c-a494-b72e2710f66c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:12 devstack sudo[99286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-957f28ba-3bc9-441c-a494-b72e2710f66c
Jul 04 00:03:12 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:12 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.089s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:12 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:03:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Deleted volume successfully.
Jul 04 00:03:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1394f8dc-e18e-45fe-aada-afeb05d0a39b tempest-VolumesListTestJSON-1146773030 None] Lock "cinder-a47025d6-06b6-4617-a0f1-138d10129b3e-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:13 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-957f28ba-3bc9-441c-a494-b72e2710f66c" returned: 0 in 1.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-957f28ba-3bc9-441c-a494-b72e2710f66c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:13 devstack sudo[99292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-957f28ba-3bc9-441c-a494-b72e2710f66c
Jul 04 00:03:13 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:13 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-957f28ba-3bc9-441c-a494-b72e2710f66c" returned: 0 in 0.681s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Lock "cinder-quobyte-957f28ba-3bc9-441c-a494-b72e2710f66c" released by "delete_volume" :: held 1.775s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:13 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=79,cinder:INSERT=32,cinder:UPDATE=96,cinder:DELETE=13 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:03:13 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=86,cinder:INSERT=37,cinder:UPDATE=105,cinder:DELETE=4 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:03:13 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Created reservations ['6771e7d6-1663-4c0f-ad3c-ccbc820888d5', 'fc83b062-3ff9-4c4f-baac-3850d43669fe', '2072d337-97ee-46a6-9986-e3083cb78db3', 'ec4bb6bf-13ad-4b76-b633-12a7c0b7e371'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:03:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:14 devstack sudo[99296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:03:14 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.748s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:14 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:03:14 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:14 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Deleted volume successfully.
Jul 04 00:03:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4e3606d1-e103-4588-aaed-1840cb37413c tempest-VolumesListTestJSON-1146773030 None] Lock "cinder-957f28ba-3bc9-441c-a494-b72e2710f66c-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:24 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=5 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:03:24 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=10,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Flow 'volume_create_manager' (16a733e0-3fd2-4c1b-963b-6d0dfeba78e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37813f21-b817-4edd-9689-52ca81170273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37813f21-b817-4edd-9689-52ca81170273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-17694867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de72bb34-3c0a-489e-b172-90851b8aeeac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c624c9887546c796b580bf20e29b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:30Z,use_quota=True,user_id='04b0e93ad944415ab4476034fe07f8e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a270a8-a268-4d0c-87c6-5af7ec74fa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a270a8-a268-4d0c-87c6-5af7ec74fa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c998e090-0e16-4e93-992c-4aed8282479b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c998e090-0e16-4e93-992c-4aed8282479b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de72bb34-3c0a-489e-b172-90851b8aeeac', 'volume_name': 'volume-de72bb34-3c0a-489e-b172-90851b8aeeac', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c416330-9d7c-42d8-beb0-a5c816f86699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c416330-9d7c-42d8-beb0-a5c816f86699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32005ea5-e0a6-46cd-8717-213d9fdb7c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:30 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Volume de72bb34-3c0a-489e-b172-90851b8aeeac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de72bb34-3c0a-489e-b172-90851b8aeeac', 'volume_size': 1}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-17694867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de72bb34-3c0a-489e-b172-90851b8aeeac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c624c9887546c796b580bf20e29b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:30Z,use_quota=True,user_id='04b0e93ad944415ab4476034fe07f8e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Creating volume de72bb34-3c0a-489e-b172-90851b8aeeac {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:03:30 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:03:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:30 devstack sudo[99309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac 1073741824
Jul 04 00:03:30 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:31 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac 1073741824" returned: 0 in 1.048s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:31 devstack sudo[99316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac
Jul 04 00:03:31 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:32 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac" returned: 0 in 0.779s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:03:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32005ea5-e0a6-46cd-8717-213d9fdb7c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de72bb34-3c0a-489e-b172-90851b8aeeac', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce7d8f0-9174-46f5-8241-6f3be3c3381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:32 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Volume volume-de72bb34-3c0a-489e-b172-90851b8aeeac (de72bb34-3c0a-489e-b172-90851b8aeeac): created successfully
Jul 04 00:03:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce7d8f0-9174-46f5-8241-6f3be3c3381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Flow 'volume_create_manager' (16a733e0-3fd2-4c1b-963b-6d0dfeba78e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-dee9efba-a7a7-490d-9536-12a24e123be4 tempest-VolumesSnapshotTestJSON-1812779632 None] Created volume successfully.
Jul 04 00:03:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] Creating offline snapshot d4702836-2d88-41a7-8adc-0eabbb50cfd6 of volume de72bb34-3c0a-489e-b172-90851b8aeeac {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:03:33 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b03e8e-c1f2-43e1-8eb4-1903ffdd4187]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:33 devstack sudo[99320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac
Jul 04 00:03:33 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:34 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac" returned: 0 in 0.955s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:34 devstack sudo[99325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6 1G
Jul 04 00:03:34 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:35 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6 1G" returned: 0 in 1.084s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de72bb34-3c0a-489e-b172-90851b8aeeac -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:35 devstack sudo[99331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de72bb34-3c0a-489e-b172-90851b8aeeac -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6
Jul 04 00:03:35 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:36 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de72bb34-3c0a-489e-b172-90851b8aeeac -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6" returned: 0 in 0.785s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:36 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6 is being set with open permissions: ugo+rw
Jul 04 00:03:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:36 devstack sudo[99336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6
Jul 04 00:03:36 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:37 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6" returned: 0 in 0.746s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:37 devstack sudo[99341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.info
Jul 04 00:03:37 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:38 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.info" returned: 0 in 0.937s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:38 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.info is being set with open permissions: ugo+rw
Jul 04 00:03:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:38 devstack sudo[99344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.info
Jul 04 00:03:38 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:38 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.info" returned: 0 in 0.767s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.413s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-48047669-e45a-4d58-bee4-db79ad399ee0 tempest-VolumesSnapshotTestJSON-1812779632 None] Create snapshot completed successfully
Jul 04 00:03:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-d4702836-2d88-41a7-8adc-0eabbb50cfd6-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-d4702836-2d88-41a7-8adc-0eabbb50cfd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-de72bb34-3c0a-489e-b172-90851b8aeeac" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-de72bb34-3c0a-489e-b172-90851b8aeeac" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-d4702836-2d88-41a7-8adc-0eabbb50cfd6" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-d4702836-2d88-41a7-8adc-0eabbb50cfd6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Deleting offline snapshot d4702836-2d88-41a7-8adc-0eabbb50cfd6 of volume de72bb34-3c0a-489e-b172-90851b8aeeac {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:03:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] snapshot_file for this snap is: volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:03:40 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fc94ee-579b-421b-80fd-975ed770235a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:40 devstack sudo[99347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6
Jul 04 00:03:40 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:41 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6" returned: 0 in 1.035s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de72bb34-3c0a-489e-b172-90851b8aeeac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:03:41 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e34532-9ca2-4765-8c4a-5f71656d2812]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:41 devstack sudo[99353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac
Jul 04 00:03:41 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:42 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac" returned: 0 in 0.929s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:42 devstack sudo[99359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6
Jul 04 00:03:42 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:43 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6" returned: 0 in 1.025s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:43 devstack sudo[99365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6
Jul 04 00:03:43 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:44 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac.d4702836-2d88-41a7-8adc-0eabbb50cfd6" returned: 0 in 0.838s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-d4702836-2d88-41a7-8adc-0eabbb50cfd6" released by "_delete_snapshot" :: held 3.980s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-de72bb34-3c0a-489e-b172-90851b8aeeac" released by "delete_snapshot" :: held 4.008s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:44 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Created reservations ['119c1bbc-6952-42aa-950c-4383ced207d2', '78cf49e7-26f1-4845-9603-c372be4dd77d', 'e32ca153-2f1d-41f1-8f44-3d3457581120', 'df936821-ffb9-4e20-8a11-886cec5bb934'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:03:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Delete snapshot completed successfully.
Jul 04 00:03:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbe3c9a0-a145-4d06-8635-65055302edec tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-d4702836-2d88-41a7-8adc-0eabbb50cfd6-delete_snapshot" released by "delete_snapshot" :: held 4.294s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Flow 'volume_create_manager' (a269b7a2-98ab-416d-9aa5-97db8d00e992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb8dc9d-96ef-46c4-a19d-284add2109a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb8dc9d-96ef-46c4-a19d-284add2109a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-152211513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf4f582-9985-47df-a407-78123cf1b1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1dfd8a1a3a4d1ba940e2cee9bae8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:45Z,use_quota=True,user_id='7f0aceafdd9248f6b278b5cce8daece6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593f6d3b-f2c6-4fe5-b6b6-e62bab43c188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (593f6d3b-f2c6-4fe5-b6b6-e62bab43c188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c9743e-450f-493d-83ee-ecece654bc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c9743e-450f-493d-83ee-ecece654bc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf4f582-9985-47df-a407-78123cf1b1c3', 'volume_name': 'volume-fdf4f582-9985-47df-a407-78123cf1b1c3', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da20530e-1ee2-4df7-bf47-4d1e5379f91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da20530e-1ee2-4df7-bf47-4d1e5379f91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40d1ea5-b933-419b-a152-f43eec11dee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:45 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Volume fdf4f582-9985-47df-a407-78123cf1b1c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf4f582-9985-47df-a407-78123cf1b1c3', 'volume_size': 1}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-152211513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf4f582-9985-47df-a407-78123cf1b1c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1dfd8a1a3a4d1ba940e2cee9bae8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:45Z,use_quota=True,user_id='7f0aceafdd9248f6b278b5cce8daece6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Creating volume fdf4f582-9985-47df-a407-78123cf1b1c3 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:03:45 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:03:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:45 devstack sudo[99368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3 1073741824
Jul 04 00:03:45 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Flow 'volume_create_manager' (46d76f8c-7666-4de0-a408-9efbf9e22946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d45ffe8-0e51-4e39-b425-d6d489b5b0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d45ffe8-0e51-4e39-b425-d6d489b5b0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-789698722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b88997-fa5f-46aa-b97c-c26099a593f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1dfd8a1a3a4d1ba940e2cee9bae8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:46Z,use_quota=True,user_id='7f0aceafdd9248f6b278b5cce8daece6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a29f93-ad8f-4607-9d44-25154a1fa011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a29f93-ad8f-4607-9d44-25154a1fa011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c43656-0a48-412c-87a1-bd0158249199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c43656-0a48-412c-87a1-bd0158249199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b88997-fa5f-46aa-b97c-c26099a593f6', 'volume_name': 'volume-16b88997-fa5f-46aa-b97c-c26099a593f6', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d53a74-c2f9-4e7a-9882-eae754cd6802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d53a74-c2f9-4e7a-9882-eae754cd6802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ebad33-9bb8-4df3-8a25-b052bb489b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:46 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Volume 16b88997-fa5f-46aa-b97c-c26099a593f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b88997-fa5f-46aa-b97c-c26099a593f6', 'volume_size': 1}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Flow 'volume_create_manager' (ff07bb61-5a42-4089-8ba3-4d16376c4833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b5d1e2-4dcb-4e50-ba17-b45a72a074e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b5d1e2-4dcb-4e50-ba17-b45a72a074e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-740232941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c624c9887546c796b580bf20e29b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:47Z,use_quota=True,user_id='04b0e93ad944415ab4476034fe07f8e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76575bd1-2a76-439a-b2ac-bfab27673280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76575bd1-2a76-439a-b2ac-bfab27673280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9a0e8a-a89f-4145-9760-d413ae291a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9a0e8a-a89f-4145-9760-d413ae291a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a', 'volume_name': 'volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f2bf3db-7dad-4c2f-8a48-5f537ddb5eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f2bf3db-7dad-4c2f-8a48-5f537ddb5eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb6aee5-f5fd-42b0-9c43-0dc120e22050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:46 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Volume cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a', 'volume_size': 1}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3 1073741824" returned: 0 in 1.283s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:46 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:46 devstack sudo[99375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3
Jul 04 00:03:46 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:47 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3" returned: 0 in 0.798s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] <== create_volume: return (2131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.354s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-789698722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b88997-fa5f-46aa-b97c-c26099a593f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a1dfd8a1a3a4d1ba940e2cee9bae8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:46Z,use_quota=True,user_id='7f0aceafdd9248f6b278b5cce8daece6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Creating volume 16b88997-fa5f-46aa-b97c-c26099a593f6 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:03:47 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:47 devstack sudo[99378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6 1073741824
Jul 04 00:03:47 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40d1ea5-b933-419b-a152-f43eec11dee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf4f582-9985-47df-a407-78123cf1b1c3', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b0e651-861d-4d3c-b190-706f4458d526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:47 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Volume volume-fdf4f582-9985-47df-a407-78123cf1b1c3 (fdf4f582-9985-47df-a407-78123cf1b1c3): created successfully
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40b0e651-861d-4d3c-b190-706f4458d526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Flow 'volume_create_manager' (a269b7a2-98ab-416d-9aa5-97db8d00e992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:47 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-936f0428-03b2-4647-b349-267b372a764e tempest-TestServerVolumeAttachmentScenario-516990465 None] Created volume successfully.
Jul 04 00:03:48 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6 1073741824" returned: 0 in 1.198s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:49 devstack sudo[99384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6
Jul 04 00:03:49 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:49 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6" returned: 0 in 0.796s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.133s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-740232941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c624c9887546c796b580bf20e29b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:47Z,use_quota=True,user_id='04b0e93ad944415ab4476034fe07f8e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Creating volume cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:03:49 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:49 devstack sudo[99387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a 1073741824
Jul 04 00:03:49 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32ebad33-9bb8-4df3-8a25-b052bb489b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b88997-fa5f-46aa-b97c-c26099a593f6', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68369fc0-2eec-4029-9898-e6b3df6e2723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:49 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Volume volume-16b88997-fa5f-46aa-b97c-c26099a593f6 (16b88997-fa5f-46aa-b97c-c26099a593f6): created successfully
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68369fc0-2eec-4029-9898-e6b3df6e2723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Flow 'volume_create_manager' (46d76f8c-7666-4de0-a408-9efbf9e22946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:49 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-438641b9-6d95-4bbb-8982-baa0d95ac112 tempest-TestServerVolumeAttachmentScenario-516990465 None] Created volume successfully.
Jul 04 00:03:51 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a 1073741824" returned: 0 in 1.280s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:51 devstack sudo[99397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a
Jul 04 00:03:51 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:51 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" returned: 0 in 0.827s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:03:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb6aee5-f5fd-42b0-9c43-0dc120e22050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf71d39-c9bb-4149-b003-3e8ccd35d338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:52 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Volume volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a (cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a): created successfully
Jul 04 00:03:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf71d39-c9bb-4149-b003-3e8ccd35d338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Flow 'volume_create_manager' (ff07bb61-5a42-4089-8ba3-4d16376c4833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:52 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cebf2b8b-5562-4cbf-8ea7-ed00e2148b20 tempest-VolumesSnapshotTestJSON-1812779632 None] Created volume successfully.
Jul 04 00:03:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] Creating offline snapshot 16209945-76d4-40c5-b32c-c7a2c0dcd857 of volume cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:03:53 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe5d41-95f6-44c9-8b95-915aa9272239]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:53 devstack sudo[99400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a
Jul 04 00:03:53 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:53 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" returned: 0 in 0.847s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:53 devstack sudo[99405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857 1G
Jul 04 00:03:53 devstack sudo[99405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:54 devstack sudo[99405]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857 1G" returned: 0 in 0.990s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:54 devstack sudo[99411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857
Jul 04 00:03:54 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:55 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857" returned: 0 in 0.905s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:55 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857 is being set with open permissions: ugo+rw
Jul 04 00:03:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:55 devstack sudo[99417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857
Jul 04 00:03:55 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:56 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857" returned: 0 in 0.794s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:56 devstack sudo[99420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.info
Jul 04 00:03:56 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:57 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.info" returned: 0 in 0.794s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:57 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.info is being set with open permissions: ugo+rw
Jul 04 00:03:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:57 devstack sudo[99424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.info
Jul 04 00:03:57 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:58 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.info" returned: 0 in 0.865s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.316s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:58 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4eb3b108-f288-462f-bb24-8c4f747a522a tempest-VolumesSnapshotTestJSON-1812779632 None] Create snapshot completed successfully
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Flow 'volume_create_manager' (57831622-8c2b-4eb6-9f0c-4653812f992a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed00642-4c5a-4668-8dde-a1b5eda62120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed00642-4c5a-4668-8dde-a1b5eda62120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-48818791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a980218-5ce6-4883-8938-9c343cc9034a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c624c9887546c796b580bf20e29b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=16209945-76d4-40c5-b32c-c7a2c0dcd857,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:00Z,use_quota=True,user_id='04b0e93ad944415ab4476034fe07f8e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4caef692-ec37-4cf5-ba9f-d4608c6a69fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4caef692-ec37-4cf5-ba9f-d4608c6a69fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788b20d9-51cf-448f-800a-2255b2a337d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (788b20d9-51cf-448f-800a-2255b2a337d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9a980218-5ce6-4883-8938-9c343cc9034a', 'volume_name': 'volume-9a980218-5ce6-4883-8938-9c343cc9034a', 'volume_size': 2, 'snapshot_id': '16209945-76d4-40c5-b32c-c7a2c0dcd857'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (907316ee-0037-4371-b483-421dd2242ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (907316ee-0037-4371-b483-421dd2242ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a548a3e-af1d-433e-a60c-6e10ebf3b708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:00 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Volume 9a980218-5ce6-4883-8938-9c343cc9034a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9a980218-5ce6-4883-8938-9c343cc9034a', 'volume_size': 2, 'snapshot_id': '16209945-76d4-40c5-b32c-c7a2c0dcd857'}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-16209945-76d4-40c5-b32c-c7a2c0dcd857-9a980218-5ce6-4883-8938-9c343cc9034a" by "_create_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-16209945-76d4-40c5-b32c-c7a2c0dcd857-9a980218-5ce6-4883-8938-9c343cc9034a" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Creating volume 9a980218-5ce6-4883-8938-9c343cc9034a from snapshot 16209945-76d4-40c5-b32c-c7a2c0dcd857 {{(pid=86648) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-9a980218-5ce6-4883-8938-9c343cc9034a" by "_copy_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-9a980218-5ce6-4883-8938-9c343cc9034a" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] snapshot: 16209945-76d4-40c5-b32c-c7a2c0dcd857, volume: 9a980218-5ce6-4883-8938-9c343cc9034a,  {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec88fae7-22b5-4558-9064-64e0586b4f30]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:00 devstack sudo[99445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857
Jul 04 00:04:00 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:01 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857" returned: 0 in 0.866s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:04:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] will copy from snapshot at /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:04:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Creating direct copy from snapshot {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:04:01 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[255a5589-2136-47d0-9e60-c71b0494a043]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:01 devstack sudo[99451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a
Jul 04 00:04:01 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:02 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" returned: 0 in 1.202s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:02 devstack cinder-volume[86648]: DEBUG cinder.utils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Path /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a not found in is_blk_device check {{(pid=86648) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:04:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:02 devstack sudo[99501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a
Jul 04 00:04:02 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:04:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:05 devstack sudo[99537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:04:05 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:07 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 2.790s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:07 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:04:07 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:04:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:04:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:04:10 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=28,cinder:UPDATE=21,cinder:DELETE=4,cinder:INSERT=5 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:04:10 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=23,cinder:SELECT=30,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:04:10 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a" returned: 0 in 8.086s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:10 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2a84a1-c6a9-4e8c-ba8d-036e1340a14f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:10 devstack sudo[99543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a
Jul 04 00:04:10 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:11 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" returned: 0 in 1.216s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:11 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a, size 1024.00 MB, duration 8.09 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:04:11 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Converted 1024.00 MB image at 126.61 MB/s
Jul 04 00:04:11 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a is being set with open permissions: ugo+rw
Jul 04 00:04:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:11 devstack sudo[99549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a
Jul 04 00:04:11 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:12 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a" returned: 0 in 1.091s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-9a980218-5ce6-4883-8938-9c343cc9034a" released by "_copy_volume_from_snapshot" :: held 12.626s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-16209945-76d4-40c5-b32c-c7a2c0dcd857-9a980218-5ce6-4883-8938-9c343cc9034a" released by "_create_volume_from_snapshot" :: held 12.682s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.698s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a548a3e-af1d-433e-a60c-6e10ebf3b708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a980218-5ce6-4883-8938-9c343cc9034a', 'volume_size': 2, 'snapshot_id': '16209945-76d4-40c5-b32c-c7a2c0dcd857'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db2094a-9ae6-4fab-a5ea-4e3c896b13cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:13 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Volume volume-9a980218-5ce6-4883-8938-9c343cc9034a (9a980218-5ce6-4883-8938-9c343cc9034a): created successfully
Jul 04 00:04:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db2094a-9ae6-4fab-a5ea-4e3c896b13cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Flow 'volume_create_manager' (57831622-8c2b-4eb6-9f0c-4653812f992a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-98af5b28-6b2f-4a49-b38f-ac37a2dad79c tempest-VolumesSnapshotTestJSON-1812779632 None] Created volume successfully.
Jul 04 00:04:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-9a980218-5ce6-4883-8938-9c343cc9034a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-9a980218-5ce6-4883-8938-9c343cc9034a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-9a980218-5ce6-4883-8938-9c343cc9034a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-9a980218-5ce6-4883-8938-9c343cc9034a" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:14 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4104ec9-1d8c-4435-904d-be8f24e539c0]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:14 devstack sudo[99592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a
Jul 04 00:04:14 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:15 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a" returned: 0 in 0.904s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:15 devstack sudo[99598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a
Jul 04 00:04:15 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:15 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-9a980218-5ce6-4883-8938-9c343cc9034a" returned: 0 in 0.699s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-9a980218-5ce6-4883-8938-9c343cc9034a" released by "delete_volume" :: held 1.653s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:15 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Created reservations ['79d7ff76-133b-48c3-a789-a68469d96513', 'a75dfdc6-3fba-49c6-8355-5b7155c20fbd', 'b8892adb-67d8-4238-bae6-f4ecbd48a73e', 'faba0701-802d-408c-ba14-f833bebbeb5d'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:04:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:16 devstack sudo[99601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:04:16 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-16209945-76d4-40c5-b32c-c7a2c0dcd857-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-16209945-76d4-40c5-b32c-c7a2c0dcd857-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-16209945-76d4-40c5-b32c-c7a2c0dcd857" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-16209945-76d4-40c5-b32c-c7a2c0dcd857" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Deleting offline snapshot 16209945-76d4-40c5-b32c-c7a2c0dcd857 of volume cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] snapshot_file for this snap is: volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0505aca5-bf52-468e-96ab-b63985a612e7]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:16 devstack sudo[99603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857
Jul 04 00:04:16 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:16 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.688s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:04:16 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Deleted volume successfully.
Jul 04 00:04:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d30a5aea-86ba-4d77-b062-1fc16e8a8c14 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-9a980218-5ce6-4883-8938-9c343cc9034a-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:17 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857" returned: 0 in 0.854s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:04:17 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5aaa788-1dc6-4374-a596-91179f856f1f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:17 devstack sudo[99610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a
Jul 04 00:04:17 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:18 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" returned: 0 in 0.878s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:18 devstack sudo[99631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857
Jul 04 00:04:18 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:19 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857" returned: 0 in 0.993s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:19 devstack sudo[99636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857
Jul 04 00:04:19 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:20 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a.16209945-76d4-40c5-b32c-c7a2c0dcd857" returned: 0 in 0.741s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-16209945-76d4-40c5-b32c-c7a2c0dcd857" released by "_delete_snapshot" :: held 3.615s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" released by "delete_snapshot" :: held 3.649s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:20 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Created reservations ['09f4515c-6a37-400f-a085-7d2304eb1b81', '28015078-9b23-481a-ae3d-9fbd77b62ad8', '779d6fa6-b831-465f-9eb7-bcf84d37ba2f', '6c67c863-31c8-4740-be19-44078b12423c'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:04:20 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Delete snapshot completed successfully.
Jul 04 00:04:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca713251-cf95-4f3b-8232-e669db6bf84c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-16209945-76d4-40c5-b32c-c7a2c0dcd857-delete_snapshot" released by "delete_snapshot" :: held 3.837s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:20 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fcb32b-24cc-43aa-bd37-0ca14d0d6e2d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:21 devstack sudo[99658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a
Jul 04 00:04:21 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:21 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" returned: 0 in 0.760s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:21 devstack sudo[99663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a
Jul 04 00:04:21 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:22 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" returned: 0 in 0.665s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:22 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a" released by "delete_volume" :: held 1.495s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:22 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Created reservations ['b82b1b93-526c-4c72-b217-39ee93c2dd5f', '39891ade-ec4f-4b2e-ad68-8df81219cd5d', '1182aa20-5bba-47e7-bb03-7eec00d5c0fe', '89dfea5c-c884-4fe3-a88a-96c5008389f0'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:04:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:22 devstack sudo[99666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:04:22 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:23 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.648s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:04:23 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Deleted volume successfully.
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c9f38779-a4e9-4048-9e84-3c7cab1735bd tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-cf2c8fe8-7bfb-4d80-aa2a-c230da513a7a-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Flow 'volume_create_manager' (0f80e3c9-6ded-4159-8c3a-1fb626bb13f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa67c48-7771-4782-b04c-fe6be36bf5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa67c48-7771-4782-b04c-fe6be36bf5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-18343334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d683c7e5-7013-4822-aeac-f7fc8932d8a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c624c9887546c796b580bf20e29b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:24Z,use_quota=True,user_id='04b0e93ad944415ab4476034fe07f8e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364adcd8-d8b9-4a74-8cf6-be53d4513498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364adcd8-d8b9-4a74-8cf6-be53d4513498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb4df83-11a0-40da-a27b-3981151f913b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb4df83-11a0-40da-a27b-3981151f913b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd683c7e5-7013-4822-aeac-f7fc8932d8a4', 'volume_name': 'volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8f4033-b2d1-48ea-b6a4-18c8e9e82cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8f4033-b2d1-48ea-b6a4-18c8e9e82cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5209196-07e6-4a51-8a38-a0c7af135a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:23 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Volume d683c7e5-7013-4822-aeac-f7fc8932d8a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4', 'volume_size': 1}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-18343334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d683c7e5-7013-4822-aeac-f7fc8932d8a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c624c9887546c796b580bf20e29b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:24Z,use_quota=True,user_id='04b0e93ad944415ab4476034fe07f8e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Creating volume d683c7e5-7013-4822-aeac-f7fc8932d8a4 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:04:23 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:04:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:23 devstack sudo[99702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 1073741824
Jul 04 00:04:23 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:24 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 1073741824" returned: 0 in 0.998s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:25 devstack sudo[99727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4
Jul 04 00:04:25 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:25 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4" returned: 0 in 0.711s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:04:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5209196-07e6-4a51-8a38-a0c7af135a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4db7f4-1fa9-4663-908e-2b7af1500390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:25 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Volume volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 (d683c7e5-7013-4822-aeac-f7fc8932d8a4): created successfully
Jul 04 00:04:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4db7f4-1fa9-4663-908e-2b7af1500390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Flow 'volume_create_manager' (0f80e3c9-6ded-4159-8c3a-1fb626bb13f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:25 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-466cce69-602e-49c5-88a3-f31d594b0a26 tempest-VolumesSnapshotTestJSON-1812779632 None] Created volume successfully.
Jul 04 00:04:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] Creating offline snapshot fe460d3e-4ff2-4565-b763-57da697846ab of volume d683c7e5-7013-4822-aeac-f7fc8932d8a4 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:04:27 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b429cc73-84fc-4965-9ffc-38a3db1e729f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:27 devstack sudo[99751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4
Jul 04 00:04:27 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:27 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4" returned: 0 in 0.916s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:28 devstack sudo[99756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab 1G
Jul 04 00:04:28 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:29 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab 1G" returned: 0 in 1.133s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:29 devstack sudo[99763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab
Jul 04 00:04:29 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:29 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab" returned: 0 in 0.737s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:29 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab is being set with open permissions: ugo+rw
Jul 04 00:04:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:29 devstack sudo[99769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab
Jul 04 00:04:29 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:30 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab" returned: 0 in 0.679s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:30 devstack sudo[99772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.info
Jul 04 00:04:30 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:31 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.info" returned: 0 in 0.675s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:31 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.info is being set with open permissions: ugo+rw
Jul 04 00:04:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:31 devstack sudo[99778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.info
Jul 04 00:04:31 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:31 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.info" returned: 0 in 0.763s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.034s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-28570bd2-2124-4e8a-9de7-5ad25af4a6db tempest-VolumesSnapshotTestJSON-1812779632 None] Create snapshot completed successfully
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Flow 'volume_create_manager' (243084c6-7681-40ef-ab6f-9a0af6e2631c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e64bd10-054b-4cde-940c-a26c007b4796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e64bd10-054b-4cde-940c-a26c007b4796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1447011917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0c515e0-8e90-481e-a415-7149c75cedf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87c624c9887546c796b580bf20e29b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe460d3e-4ff2-4565-b763-57da697846ab,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:33Z,use_quota=True,user_id='04b0e93ad944415ab4476034fe07f8e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b978c4f0-0357-4b02-b864-539cc3a3bfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b978c4f0-0357-4b02-b864-539cc3a3bfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222fc5c1-399c-4096-8e2d-0de74809f41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222fc5c1-399c-4096-8e2d-0de74809f41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f0c515e0-8e90-481e-a415-7149c75cedf5', 'volume_name': 'volume-f0c515e0-8e90-481e-a415-7149c75cedf5', 'volume_size': 1, 'snapshot_id': 'fe460d3e-4ff2-4565-b763-57da697846ab'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0923c8a-a2d0-4c35-9963-27a08826d6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0923c8a-a2d0-4c35-9963-27a08826d6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d08c4f-30fd-4034-bf15-68031760fd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:32 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Volume f0c515e0-8e90-481e-a415-7149c75cedf5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f0c515e0-8e90-481e-a415-7149c75cedf5', 'volume_size': 1, 'snapshot_id': 'fe460d3e-4ff2-4565-b763-57da697846ab'}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-fe460d3e-4ff2-4565-b763-57da697846ab-f0c515e0-8e90-481e-a415-7149c75cedf5" by "_create_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-fe460d3e-4ff2-4565-b763-57da697846ab-f0c515e0-8e90-481e-a415-7149c75cedf5" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Creating volume f0c515e0-8e90-481e-a415-7149c75cedf5 from snapshot fe460d3e-4ff2-4565-b763-57da697846ab {{(pid=86648) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-f0c515e0-8e90-481e-a415-7149c75cedf5" by "_copy_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-f0c515e0-8e90-481e-a415-7149c75cedf5" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] snapshot: fe460d3e-4ff2-4565-b763-57da697846ab, volume: f0c515e0-8e90-481e-a415-7149c75cedf5,  {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8211b07d-b8c0-48ba-899c-7b08a7ddfe4e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:33 devstack sudo[99784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab
Jul 04 00:04:33 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:33 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab" returned: 0 in 0.757s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] will copy from snapshot at /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Creating direct copy from snapshot {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79cf97c-15c8-4311-b0ea-cbfb11b3a1df]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:33 devstack sudo[99789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4
Jul 04 00:04:33 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:34 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4" returned: 0 in 0.785s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:34 devstack cinder-volume[86648]: DEBUG cinder.utils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Path /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5 not found in is_blk_device check {{(pid=86648) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:04:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:34 devstack sudo[99794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5
Jul 04 00:04:34 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-61a4cfe7-a5f5-4531-ad94-b905200e4f7a req-daeb69bf-50ba-4c09-b8a3-ab78137e6742 tempest-TestServerVolumeAttachmentScenario-516990465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:40 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5" returned: 0 in 5.591s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:40 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0a18c4-83c7-4b62-b3eb-445c83df384f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:40 devstack sudo[99852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4
Jul 04 00:04:40 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:41 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4" returned: 0 in 0.975s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:04:41 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Converted 1024.00 MB image at 183.10 MB/s
Jul 04 00:04:41 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5 is being set with open permissions: ugo+rw
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:41 devstack sudo[99858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5
Jul 04 00:04:41 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:41 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5" returned: 0 in 0.674s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-f0c515e0-8e90-481e-a415-7149c75cedf5" released by "_copy_volume_from_snapshot" :: held 8.874s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-fe460d3e-4ff2-4565-b763-57da697846ab-f0c515e0-8e90-481e-a415-7149c75cedf5" released by "_create_volume_from_snapshot" :: held 8.901s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.918s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-61a4cfe7-a5f5-4531-ad94-b905200e4f7a req-daeb69bf-50ba-4c09-b8a3-ab78137e6742 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.831s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29d8699-39dd-461d-b242-c34136a9bcd8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-61a4cfe7-a5f5-4531-ad94-b905200e4f7a req-daeb69bf-50ba-4c09-b8a3-ab78137e6742 tempest-TestServerVolumeAttachmentScenario-516990465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d08c4f-30fd-4034-bf15-68031760fd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0c515e0-8e90-481e-a415-7149c75cedf5', 'volume_size': 1, 'snapshot_id': 'fe460d3e-4ff2-4565-b763-57da697846ab'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecb1552-6649-45dd-820c-15220df1daf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:41 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Volume volume-f0c515e0-8e90-481e-a415-7149c75cedf5 (f0c515e0-8e90-481e-a415-7149c75cedf5): created successfully
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ecb1552-6649-45dd-820c-15220df1daf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Flow 'volume_create_manager' (243084c6-7681-40ef-ab6f-9a0af6e2631c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:41 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-fe7f4f38-22f8-458e-9b3f-33db284c1567 tempest-VolumesSnapshotTestJSON-1812779632 None] Created volume successfully.
Jul 04 00:04:42 devstack sudo[99861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3
Jul 04 00:04:42 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:42 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-61a4cfe7-a5f5-4531-ad94-b905200e4f7a req-daeb69bf-50ba-4c09-b8a3-ab78137e6742 tempest-TestServerVolumeAttachmentScenario-516990465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3" returned: 0 in 0.754s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-61a4cfe7-a5f5-4531-ad94-b905200e4f7a req-daeb69bf-50ba-4c09-b8a3-ab78137e6742 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.781s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-61a4cfe7-a5f5-4531-ad94-b905200e4f7a req-daeb69bf-50ba-4c09-b8a3-ab78137e6742 tempest-TestServerVolumeAttachmentScenario-516990465 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-fdf4f582-9985-47df-a407-78123cf1b1c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6276fe7e-0f38-4b42-979c-c52b614ca378', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:04:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-61a4cfe7-a5f5-4531-ad94-b905200e4f7a req-daeb69bf-50ba-4c09-b8a3-ab78137e6742 tempest-TestServerVolumeAttachmentScenario-516990465 None] attachment_update completed successfully.
Jul 04 00:04:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-f0c515e0-8e90-481e-a415-7149c75cedf5-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-f0c515e0-8e90-481e-a415-7149c75cedf5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-f0c515e0-8e90-481e-a415-7149c75cedf5" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-f0c515e0-8e90-481e-a415-7149c75cedf5" acquired by "delete_volume" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:43 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c20588-7d92-4870-82bf-21bc50f269de]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:43 devstack sudo[99888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5
Jul 04 00:04:43 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:43 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5" returned: 0 in 0.774s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:43 devstack sudo[100253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5
Jul 04 00:04:43 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:44 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f0c515e0-8e90-481e-a415-7149c75cedf5" returned: 0 in 0.696s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-f0c515e0-8e90-481e-a415-7149c75cedf5" released by "delete_volume" :: held 1.518s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:44 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Created reservations ['e3f4fbb2-c7bb-4313-bd65-50da6cd56845', '24fdaa71-fcbc-4480-89cb-c5a49ffb615e', 'ac6c5db3-521d-46aa-8c00-d0b58c41f9e5', '06600f13-6bb0-40f3-bb64-30f47fdca2c7'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:04:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:44 devstack sudo[100256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:04:44 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-fe460d3e-4ff2-4565-b763-57da697846ab-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-fe460d3e-4ff2-4565-b763-57da697846ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-d683c7e5-7013-4822-aeac-f7fc8932d8a4" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-d683c7e5-7013-4822-aeac-f7fc8932d8a4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-fe460d3e-4ff2-4565-b763-57da697846ab" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-fe460d3e-4ff2-4565-b763-57da697846ab" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Deleting offline snapshot fe460d3e-4ff2-4565-b763-57da697846ab of volume d683c7e5-7013-4822-aeac-f7fc8932d8a4 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] snapshot_file for this snap is: volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fa5c2c-b1ab-4df1-a080-ab2a82601ce6]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:45 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.700s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:04:45 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Deleted volume successfully.
Jul 04 00:04:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d5c8d5e6-7151-4742-a853-755be8630455 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-f0c515e0-8e90-481e-a415-7149c75cedf5-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:45 devstack sudo[100259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab
Jul 04 00:04:45 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:46 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab" returned: 0 in 0.844s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:04:46 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4a1c77-49fc-47cd-ad83-51e0ae95c30d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:46 devstack sudo[100264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4
Jul 04 00:04:46 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:47 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4" returned: 0 in 0.749s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:47 devstack sudo[100270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab
Jul 04 00:04:47 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab" returned: 0 in 0.784s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:47 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:47 devstack sudo[100276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab
Jul 04 00:04:47 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:48 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4.fe460d3e-4ff2-4565-b763-57da697846ab" returned: 0 in 0.664s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-fe460d3e-4ff2-4565-b763-57da697846ab" released by "_delete_snapshot" :: held 3.168s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-d683c7e5-7013-4822-aeac-f7fc8932d8a4" released by "delete_snapshot" :: held 3.200s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:48 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Created reservations ['82ede3f3-65d1-4145-a9a8-901ef7cf5e1a', '62b18f29-6b88-4503-8911-aae397c02cfe', 'd693b558-b511-4ead-817b-276c7acf2053', 'e2ee169f-07aa-4208-b806-91f2aaa795cd'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:04:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Delete snapshot completed successfully.
Jul 04 00:04:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-806f81ec-0f7e-4e72-9598-2082f0a6509c tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-fe460d3e-4ff2-4565-b763-57da697846ab-delete_snapshot" released by "delete_snapshot" :: held 3.340s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-d683c7e5-7013-4822-aeac-f7fc8932d8a4-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-d683c7e5-7013-4822-aeac-f7fc8932d8a4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-d683c7e5-7013-4822-aeac-f7fc8932d8a4" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-d683c7e5-7013-4822-aeac-f7fc8932d8a4" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:49 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f96532-a1a1-4300-9805-137d54c6c8a1]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:49 devstack sudo[100284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4
Jul 04 00:04:49 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Flow 'volume_create_manager' (63462331-7fd7-472a-b903-28e84a8ee395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e410a4d-8a11-43ea-a2dd-a1f67cdcbece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e410a4d-8a11-43ea-a2dd-a1f67cdcbece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2087509302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd99523-26a7-4de1-99ff-92f96727095c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c960e55f1f94415a8cf07d1b40efcfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:50Z,use_quota=True,user_id='1c27341a49214eb8a42b1050bc1cb649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba80e8d-1d2d-47d3-8872-11f985f2f419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba80e8d-1d2d-47d3-8872-11f985f2f419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf5096e-566d-4d84-a298-304f0c9a24f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf5096e-566d-4d84-a298-304f0c9a24f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd99523-26a7-4de1-99ff-92f96727095c', 'volume_name': 'volume-4cd99523-26a7-4de1-99ff-92f96727095c', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21856265-9558-41f8-a2cd-aae4d436c123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21856265-9558-41f8-a2cd-aae4d436c123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c598756-7dc3-4119-bb85-e09da56d152c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:50 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Volume 4cd99523-26a7-4de1-99ff-92f96727095c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd99523-26a7-4de1-99ff-92f96727095c', 'volume_size': 1}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2087509302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd99523-26a7-4de1-99ff-92f96727095c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c960e55f1f94415a8cf07d1b40efcfc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:50Z,use_quota=True,user_id='1c27341a49214eb8a42b1050bc1cb649',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Creating volume 4cd99523-26a7-4de1-99ff-92f96727095c {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:04:50 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:50 devstack sudo[100286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c 1073741824
Jul 04 00:04:50 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:50 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4" returned: 0 in 0.806s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:50 devstack sudo[100292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4
Jul 04 00:04:50 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:51 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c 1073741824" returned: 0 in 0.960s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:51 devstack sudo[100298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c
Jul 04 00:04:51 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:51 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d683c7e5-7013-4822-aeac-f7fc8932d8a4" returned: 0 in 0.719s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-d683c7e5-7013-4822-aeac-f7fc8932d8a4" released by "delete_volume" :: held 1.591s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Created reservations ['24c07610-84bb-4791-af92-30de1bca98a5', 'a0b2643a-4e23-464a-a680-5e37c42aa45c', '36ccb8b2-8d7f-4098-893f-d365520a979c', 'feadae52-7026-494f-ac27-8e8c034c230f'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:51 devstack sudo[100300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:04:51 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:51 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c" returned: 0 in 0.695s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c598756-7dc3-4119-bb85-e09da56d152c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd99523-26a7-4de1-99ff-92f96727095c', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5beb655a-55b4-4dd7-a2e3-89d8928028ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:51 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Volume volume-4cd99523-26a7-4de1-99ff-92f96727095c (4cd99523-26a7-4de1-99ff-92f96727095c): created successfully
Jul 04 00:04:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5beb655a-55b4-4dd7-a2e3-89d8928028ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Flow 'volume_create_manager' (63462331-7fd7-472a-b903-28e84a8ee395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:52 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-31ff40d7-33aa-492c-a3cd-8a6e638034aa tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Created volume successfully.
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-de72bb34-3c0a-489e-b172-90851b8aeeac-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-de72bb34-3c0a-489e-b172-90851b8aeeac-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "cinder-quobyte-de72bb34-3c0a-489e-b172-90851b8aeeac" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-de72bb34-3c0a-489e-b172-90851b8aeeac" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dc2e7f-50fb-4e58-b617-9c94bb244bc9]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:52 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.772s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:04:52 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Deleted volume successfully.
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f541b704-6b51-4f9c-8e23-086de21ad080 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-d683c7e5-7013-4822-aeac-f7fc8932d8a4-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:52 devstack sudo[100304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac
Jul 04 00:04:52 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-4536b1fe-8029-4036-aab1-b5ec0cba8e30 req-05ccd672-44e9-4509-bb5c-c385556ee59a tempest-TestServerVolumeAttachmentScenario-516990465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-4536b1fe-8029-4036-aab1-b5ec0cba8e30 req-05ccd672-44e9-4509-bb5c-c385556ee59a tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd069eda-9f83-4858-9ad7-b2482851f755]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-4536b1fe-8029-4036-aab1-b5ec0cba8e30 req-05ccd672-44e9-4509-bb5c-c385556ee59a tempest-TestServerVolumeAttachmentScenario-516990465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:52 devstack sudo[100317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6
Jul 04 00:04:52 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:53 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac" returned: 0 in 0.847s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:53 devstack sudo[100322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac
Jul 04 00:04:53 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:53 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-4536b1fe-8029-4036-aab1-b5ec0cba8e30 req-05ccd672-44e9-4509-bb5c-c385556ee59a tempest-TestServerVolumeAttachmentScenario-516990465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6" returned: 0 in 0.803s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-4536b1fe-8029-4036-aab1-b5ec0cba8e30 req-05ccd672-44e9-4509-bb5c-c385556ee59a tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-4536b1fe-8029-4036-aab1-b5ec0cba8e30 req-05ccd672-44e9-4509-bb5c-c385556ee59a tempest-TestServerVolumeAttachmentScenario-516990465 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-16b88997-fa5f-46aa-b97c-c26099a593f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bddac0d-7849-4398-84f5-c784e9342098', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:04:53 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-4536b1fe-8029-4036-aab1-b5ec0cba8e30 req-05ccd672-44e9-4509-bb5c-c385556ee59a tempest-TestServerVolumeAttachmentScenario-516990465 None] attachment_update completed successfully.
Jul 04 00:04:53 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-de72bb34-3c0a-489e-b172-90851b8aeeac" returned: 0 in 0.653s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-quobyte-de72bb34-3c0a-489e-b172-90851b8aeeac" released by "delete_volume" :: held 1.579s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Created reservations ['ef11b9bf-3f5a-40a9-9a11-d0882d41c1ab', '1d1d4d2e-8cd3-4273-9988-f315a5d9b343', 'eb568c24-14ac-4575-8a10-43c0220d3aa8', '577b278f-349c-4030-af37-b5a5ecbed1cc'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:53 devstack sudo[100328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:04:53 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:54 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.746s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:54 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:04:54 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Deleted volume successfully.
Jul 04 00:04:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-299740d5-b2c2-4c56-a526-7022490a9c56 tempest-VolumesSnapshotTestJSON-1812779632 None] Lock "cinder-de72bb34-3c0a-489e-b172-90851b8aeeac-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-2d7e34ed-05fa-4c5f-b08e-c6df0163611a req-641f32fc-1c4c-4c08-bbdd-5aa5be613741 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-2d7e34ed-05fa-4c5f-b08e-c6df0163611a req-641f32fc-1c4c-4c08-bbdd-5aa5be613741 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:55 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6719fa31-f5a1-4785-868a-c6561b454792]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-2d7e34ed-05fa-4c5f-b08e-c6df0163611a req-641f32fc-1c4c-4c08-bbdd-5aa5be613741 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:55 devstack sudo[100344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c
Jul 04 00:04:55 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:56 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-2d7e34ed-05fa-4c5f-b08e-c6df0163611a req-641f32fc-1c4c-4c08-bbdd-5aa5be613741 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c" returned: 0 in 0.826s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-2d7e34ed-05fa-4c5f-b08e-c6df0163611a req-641f32fc-1c4c-4c08-bbdd-5aa5be613741 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.842s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-2d7e34ed-05fa-4c5f-b08e-c6df0163611a req-641f32fc-1c4c-4c08-bbdd-5aa5be613741 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-4cd99523-26a7-4de1-99ff-92f96727095c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c95567c9-a4a0-4f77-91bf-0a6bd8bea8df', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:04:56 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-2d7e34ed-05fa-4c5f-b08e-c6df0163611a req-641f32fc-1c4c-4c08-bbdd-5aa5be613741 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] attachment_update completed successfully.
Jul 04 00:04:59 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-624e1070-987e-464b-8c4a-12f20070b765 req-09339c55-68a9-4fce-9556-b8d45345c97b tempest-TestServerVolumeAttachmentScenario-516990465 None] Terminate volume connection completed successfully.
Jul 04 00:04:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-624e1070-987e-464b-8c4a-12f20070b765 req-09339c55-68a9-4fce-9556-b8d45345c97b tempest-TestServerVolumeAttachmentScenario-516990465 None] Deleting attachment 9bddac0d-7849-4398-84f5-c784e9342098. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:05:02 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-1e2c0bdb-45e6-48dc-b524-b8941b77d4b6 req-d3d3aab0-0ef8-4073-93f6-b3e75420166e tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Terminate volume connection completed successfully.
Jul 04 00:05:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-1e2c0bdb-45e6-48dc-b524-b8941b77d4b6 req-d3d3aab0-0ef8-4073-93f6-b3e75420166e tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Deleting attachment c95567c9-a4a0-4f77-91bf-0a6bd8bea8df. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:05:03 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-f176b512-74e4-4e11-a51d-bca1e9875a7a req-0094a9ab-024a-410f-afc7-f1c801dde3ac tempest-TestServerVolumeAttachmentScenario-516990465 None] Terminate volume connection completed successfully.
Jul 04 00:05:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-f176b512-74e4-4e11-a51d-bca1e9875a7a req-0094a9ab-024a-410f-afc7-f1c801dde3ac tempest-TestServerVolumeAttachmentScenario-516990465 None] Deleting attachment 6276fe7e-0f38-4b42-979c-c52b614ca378. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Acquiring lock "cinder-4cd99523-26a7-4de1-99ff-92f96727095c-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Lock "cinder-4cd99523-26a7-4de1-99ff-92f96727095c-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:05 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:05:05 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Acquiring lock "cinder-quobyte-4cd99523-26a7-4de1-99ff-92f96727095c" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Lock "cinder-quobyte-4cd99523-26a7-4de1-99ff-92f96727095c" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[244c6390-5479-4273-baa4-04962b84d167]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:05 devstack sudo[100391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c
Jul 04 00:05:05 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:05 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.783s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:05:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:05:06 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c" returned: 0 in 0.934s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:06 devstack sudo[100399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c
Jul 04 00:05:06 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:06 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4cd99523-26a7-4de1-99ff-92f96727095c" returned: 0 in 0.671s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Lock "cinder-quobyte-4cd99523-26a7-4de1-99ff-92f96727095c" released by "delete_volume" :: held 1.674s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:07 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Created reservations ['d4ebf0e6-f4e5-4d9f-a9a3-bbb97738acb8', '7c509a64-a23f-4fcc-a145-3e67cfacd77e', 'bd26f1da-1134-42d6-82b1-15680b2635a8', 'd27d434a-5207-4e34-8ac5-b31b85bfd9e6'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:05:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:07 devstack sudo[100407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:05:07 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:08 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.969s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:08 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:05:08 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Deleted volume successfully.
Jul 04 00:05:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d52eeb8e-50ed-4352-b707-042c5d87df40 tempest-TestServerVolumeAttachScenarioOldVersion-1108193363 None] Lock "cinder-4cd99523-26a7-4de1-99ff-92f96727095c-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Acquiring lock "cinder-16b88997-fa5f-46aa-b97c-c26099a593f6-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "cinder-16b88997-fa5f-46aa-b97c-c26099a593f6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:15 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=78,cinder:DELETE=4,cinder:SELECT=73,cinder:INSERT=22 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:05:15 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=70,cinder:UPDATE=72,cinder:INSERT=13,cinder:DELETE=7 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:05:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Acquiring lock "cinder-quobyte-16b88997-fa5f-46aa-b97c-c26099a593f6" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "cinder-quobyte-16b88997-fa5f-46aa-b97c-c26099a593f6" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:15 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b6a66a-80f7-407e-8b80-c434a8cfb48f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:15 devstack sudo[100489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6
Jul 04 00:05:15 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:15 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6" returned: 0 in 0.834s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:16 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6
Jul 04 00:05:16 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:16 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16b88997-fa5f-46aa-b97c-c26099a593f6" returned: 0 in 0.776s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "cinder-quobyte-16b88997-fa5f-46aa-b97c-c26099a593f6" released by "delete_volume" :: held 1.668s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:16 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Created reservations ['bc6a71f0-2950-4fa5-aaa4-a6ac049d79f0', '2a81733d-73a1-4f62-b344-be7da68b7575', 'c672c66b-9ae9-430c-8cb9-903f9ee6af42', '9c406adc-6b7d-4a0b-bed1-b4c6b75f2e0e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:05:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:16 devstack sudo[100497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:05:16 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Acquiring lock "cinder-fdf4f582-9985-47df-a407-78123cf1b1c3-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "cinder-fdf4f582-9985-47df-a407-78123cf1b1c3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Acquiring lock "cinder-quobyte-fdf4f582-9985-47df-a407-78123cf1b1c3" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "cinder-quobyte-fdf4f582-9985-47df-a407-78123cf1b1c3" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:17 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[968d1e71-e416-4af1-b3cd-db8228f00e04]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:17 devstack sudo[100499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3
Jul 04 00:05:17 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:17 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.893s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:17 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:05:17 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Deleted volume successfully.
Jul 04 00:05:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d21ecb66-dcbb-4f09-9405-0e4849327a43 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "cinder-16b88997-fa5f-46aa-b97c-c26099a593f6-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:18 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3" returned: 0 in 0.876s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:18 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3
Jul 04 00:05:18 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:19 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-fdf4f582-9985-47df-a407-78123cf1b1c3" returned: 0 in 0.798s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "cinder-quobyte-fdf4f582-9985-47df-a407-78123cf1b1c3" released by "delete_volume" :: held 1.743s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:19 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Created reservations ['e7b151e0-90cd-4c12-8abb-0686685be466', '1d165ef2-e36b-427f-82d0-d409f3e3ac11', '0a95e35d-3267-4dc3-b42b-b0c091b7ad27', 'ceb29c89-a28d-48eb-a8e1-e40e4202d2c0'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:05:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:19 devstack sudo[100509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:05:19 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:20 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.826s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:20 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:05:20 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Deleted volume successfully.
Jul 04 00:05:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ac343f66-58d7-4cae-8df3-3e7eae260032 tempest-TestServerVolumeAttachmentScenario-516990465 None] Lock "cinder-fdf4f582-9985-47df-a407-78123cf1b1c3-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Flow 'volume_create_manager' (97d4fab3-d6a6-4df8-8517-77d239d3df8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221ac79b-17ab-4ef9-849f-b855e846d4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221ac79b-17ab-4ef9-849f-b855e846d4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-46095317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46813e7-380d-4d73-8409-686d122c468b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf8875613644fadbcf6c0369930e12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:28Z,use_quota=True,user_id='ed00375e949d44d289e4a762a34bc4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07fd3660-c5d8-4ec8-8e64-0075aaf45ebd),volume_type_id=07fd3660-c5d8-4ec8-8e64-0075aaf45ebd)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1daf79-1355-458e-b51b-b42f57191cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1daf79-1355-458e-b51b-b42f57191cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c8fde9-07ce-4eda-b389-255cb95ba1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c8fde9-07ce-4eda-b389-255cb95ba1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a46813e7-380d-4d73-8409-686d122c468b', 'volume_name': 'volume-a46813e7-380d-4d73-8409-686d122c468b', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de963d07-77a2-4796-bf05-339bc1174849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de963d07-77a2-4796-bf05-339bc1174849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d179d8-ea6d-4057-8808-d511d5b908c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:27 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Volume a46813e7-380d-4d73-8409-686d122c468b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a46813e7-380d-4d73-8409-686d122c468b', 'volume_size': 1}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-46095317',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a46813e7-380d-4d73-8409-686d122c468b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf8875613644fadbcf6c0369930e12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:28Z,use_quota=True,user_id='ed00375e949d44d289e4a762a34bc4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(07fd3660-c5d8-4ec8-8e64-0075aaf45ebd),volume_type_id=07fd3660-c5d8-4ec8-8e64-0075aaf45ebd)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Creating volume a46813e7-380d-4d73-8409-686d122c468b {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:05:27 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:05:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:27 devstack sudo[100524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b 1073741824
Jul 04 00:05:27 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:28 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:05:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Flow 'volume_create_manager' (ffaeadca-93bb-4df5-9c59-18e48cb84559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617a932f-a70d-43c9-adfa-fa65540220c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617a932f-a70d-43c9-adfa-fa65540220c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-652306532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf8875613644fadbcf6c0369930e12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:28Z,use_quota=True,user_id='ed00375e949d44d289e4a762a34bc4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b48deadb-fff4-4ca1-9c3e-9ae1a56a67cd),volume_type_id=b48deadb-fff4-4ca1-9c3e-9ae1a56a67cd)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45374640-4ba0-4c1b-9dda-05cb81a0edaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45374640-4ba0-4c1b-9dda-05cb81a0edaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5305a42-2e0e-4795-9d84-29e655fba76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5305a42-2e0e-4795-9d84-29e655fba76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c', 'volume_name': 'volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a271d2-c3ad-4df3-adcf-d1ab672b735a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a271d2-c3ad-4df3-adcf-d1ab672b735a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd64835-f0af-4a9a-855b-4c580cbda369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:28 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Volume 6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c', 'volume_size': 1}
Jul 04 00:05:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:29 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b 1073741824" returned: 0 in 1.369s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:29 devstack sudo[100531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b
Jul 04 00:05:29 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Flow 'volume_create_manager' (becd4400-ff2f-4e7b-b274-8a283f3afbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65163d6-4773-42e9-bf1a-3b7fd6b3774d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f65163d6-4773-42e9-bf1a-3b7fd6b3774d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1722328042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69e71c4-d36a-43dd-8c08-e24e97ca9929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf8875613644fadbcf6c0369930e12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:29Z,use_quota=True,user_id='ed00375e949d44d289e4a762a34bc4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(048c3832-1be7-4210-b5af-eda6eeeeffe2),volume_type_id=048c3832-1be7-4210-b5af-eda6eeeeffe2)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967f6544-ce15-425b-a75f-d76c755e2633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967f6544-ce15-425b-a75f-d76c755e2633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32271bc7-9c22-4b61-bf58-251c9fd23906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.image.glance [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Creating Keystone auth plugin from conf {{(pid=86648) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32271bc7-9c22-4b61-bf58-251c9fd23906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd69e71c4-d36a-43dd-8c08-e24e97ca9929', 'volume_name': 'volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929', 'volume_size': 1, 'image_id': '78eb61be-ab7a-4d9c-9cd6-fff506975461', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/78eb61be-ab7a-4d9c-9cd6-fff506975461', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1822925051', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccf8875613644fadbcf6c0369930e12a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '78eb61be-ab7a-4d9c-9cd6-fff506975461', 'created_at': datetime.datetime(2026, 7, 3, 22, 5, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 5, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/78eb61be-ab7a-4d9c-9cd6-fff506975461/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c8aeab0>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dca5464-1008-424a-8dc4-1daa6dd7272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dca5464-1008-424a-8dc4-1daa6dd7272e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca445a3-234d-485e-b3f8-834ab395f9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:29 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Volume d69e71c4-d36a-43dd-8c08-e24e97ca9929: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929', 'volume_size': 1, 'image_id': '78eb61be-ab7a-4d9c-9cd6-fff506975461', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/78eb61be-ab7a-4d9c-9cd6-fff506975461', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1822925051', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccf8875613644fadbcf6c0369930e12a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '78eb61be-ab7a-4d9c-9cd6-fff506975461', 'created_at': datetime.datetime(2026, 7, 3, 22, 5, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 5, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/78eb61be-ab7a-4d9c-9cd6-fff506975461/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c8aeab0>}
Jul 04 00:05:29 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Trying to clone d69e71c4-d36a-43dd-8c08-e24e97ca9929 from image 78eb61be-ab7a-4d9c-9cd6-fff506975461 at location (None, [{'url': 'file:///opt/stack/data/glance/images/78eb61be-ab7a-4d9c-9cd6-fff506975461', 'metadata': {}}]). {{(pid=86648) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 04 00:05:30 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b" returned: 0 in 0.909s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] <== create_volume: return (2341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.344s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.855s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-652306532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf8875613644fadbcf6c0369930e12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:28Z,use_quota=True,user_id='ed00375e949d44d289e4a762a34bc4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b48deadb-fff4-4ca1-9c3e-9ae1a56a67cd),volume_type_id=b48deadb-fff4-4ca1-9c3e-9ae1a56a67cd)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Creating volume 6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:05:30 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:30 devstack sudo[100534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c 1073741824
Jul 04 00:05:30 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d179d8-ea6d-4057-8808-d511d5b908c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46813e7-380d-4d73-8409-686d122c468b', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86220ab-1313-4d8e-9530-dab249445a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:30 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Volume volume-a46813e7-380d-4d73-8409-686d122c468b (a46813e7-380d-4d73-8409-686d122c468b): created successfully
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86220ab-1313-4d8e-9530-dab249445a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Flow 'volume_create_manager' (97d4fab3-d6a6-4df8-8517-77d239d3df8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:30 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a72bbd55-4007-426f-9854-c6ded05aa1c3 tempest-TestInstancesWithCinderVolumes-1794452185 None] Created volume successfully.
Jul 04 00:05:31 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c 1073741824" returned: 0 in 1.193s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:31 devstack sudo[100542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c
Jul 04 00:05:31 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:32 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c" returned: 0 in 1.051s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:05:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd64835-f0af-4a9a-855b-4c580cbda369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f6230c-9010-4517-8a41-bcab94826740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:32 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Volume volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c (6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c): created successfully
Jul 04 00:05:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f6230c-9010-4517-8a41-bcab94826740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Flow 'volume_create_manager' (ffaeadca-93bb-4df5-9c59-18e48cb84559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-94d0fb24-092f-490b-86d4-b107f8bfcba6 tempest-TestInstancesWithCinderVolumes-1794452185 None] Created volume successfully.
Jul 04 00:05:34 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD, size 20.69 MB, duration 4.57 sec {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 04 00:05:34 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Image download 20.69 MB at 4.52 MB/s
Jul 04 00:05:34 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8430ace-fdeb-4852-8eaf-5b452bf73a89]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:34 devstack sudo[100546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD
Jul 04 00:05:34 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:35 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD" returned: 0 in 0.867s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:35 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Temporary image 78eb61be-ab7a-4d9c-9cd6-fff506975461 is fetched for user ed00375e949d44d289e4a762a34bc4cb. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 04 00:05:35 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda77ed2-aac7-4db0-8ec9-3d12e8225f20]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:35 devstack sudo[100551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD
Jul 04 00:05:35 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:36 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD" returned: 0 in 0.910s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1722328042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69e71c4-d36a-43dd-8c08-e24e97ca9929,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccf8875613644fadbcf6c0369930e12a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:29Z,use_quota=True,user_id='ed00375e949d44d289e4a762a34bc4cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(048c3832-1be7-4210-b5af-eda6eeeeffe2),volume_type_id=048c3832-1be7-4210-b5af-eda6eeeeffe2)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:05:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Creating volume d69e71c4-d36a-43dd-8c08-e24e97ca9929 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:05:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:05:36 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:05:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:36 devstack sudo[100556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 1073741824
Jul 04 00:05:36 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:37 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 1073741824" returned: 0 in 1.070s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:37 devstack sudo[100564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929
Jul 04 00:05:37 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:38 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929" returned: 0 in 0.754s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:05:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:38 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Attempting download of 78eb61be-ab7a-4d9c-9cd6-fff506975461 ((None, [{'url': 'file:///opt/stack/data/glance/images/78eb61be-ab7a-4d9c-9cd6-fff506975461', 'metadata': {}}])) to volume d69e71c4-d36a-43dd-8c08-e24e97ca9929. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 04 00:05:38 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2321a592-b190-4572-8dc0-052afe937e23]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_78eb61be-ab7a-4d9c-9cd6-fff506975461_a996gm91 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:38 devstack sudo[100567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_78eb61be-ab7a-4d9c-9cd6-fff506975461_a996gm91
Jul 04 00:05:38 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:39 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_78eb61be-ab7a-4d9c-9cd6-fff506975461_a996gm91" returned: 0 in 0.815s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_78eb61be-ab7a-4d9c-9cd6-fff506975461_a996gm91 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:39 devstack sudo[100571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_78eb61be-ab7a-4d9c-9cd6-fff506975461_a996gm91
Jul 04 00:05:39 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:39 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_78eb61be-ab7a-4d9c-9cd6-fff506975461_a996gm91" returned: 1 in 0.778s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_78eb61be-ab7a-4d9c-9cd6-fff506975461_a996gm91' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:05:39 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e028bedf-04b3-4a15-b9f5-42a258587077]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:40 devstack sudo[100575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD
Jul 04 00:05:40 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:40 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:40 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] 78eb61be-ab7a-4d9c-9cd6-fff506975461 was qcow2, converting to raw {{(pid=86648) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 04 00:05:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:40 devstack sudo[100581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929
Jul 04 00:05:40 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:43 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929" returned: 0 in 2.444s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:43 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_78eb61be-ab7a-4d9c-9cd6-fff506975461_yquerikjdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:05:43 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Converted 112.00 MB image at 45.80 MB/s
Jul 04 00:05:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:43 devstack sudo[100589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 1G
Jul 04 00:05:43 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:44 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 1G" returned: 0 in 0.829s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:44 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca5bfa9-4c40-492a-821e-f43299215995]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:44 devstack sudo[100594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929
Jul 04 00:05:44 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:45 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929" returned: 0 in 0.953s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:45 devstack sudo[100598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929
Jul 04 00:05:45 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:45 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929" returned: 1 in 0.874s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:05:45 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Downloaded image 78eb61be-ab7a-4d9c-9cd6-fff506975461 ((None, [{'url': 'file:///opt/stack/data/glance/images/78eb61be-ab7a-4d9c-9cd6-fff506975461', 'metadata': {}}])) to volume d69e71c4-d36a-43dd-8c08-e24e97ca9929 successfully. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 04 00:05:45 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Temporary image 78eb61be-ab7a-4d9c-9cd6-fff506975461 for user ed00375e949d44d289e4a762a34bc4cb is deleted. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 04 00:05:45 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Marking volume d69e71c4-d36a-43dd-8c08-e24e97ca9929 as bootable. {{(pid=86648) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 04 00:05:45 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Copying metadata from image 78eb61be-ab7a-4d9c-9cd6-fff506975461 to d69e71c4-d36a-43dd-8c08-e24e97ca9929. {{(pid=86648) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 04 00:05:45 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Creating volume glance metadata for volume d69e71c4-d36a-43dd-8c08-e24e97ca9929 backed by image 78eb61be-ab7a-4d9c-9cd6-fff506975461 with: {'image_id': '78eb61be-ab7a-4d9c-9cd6-fff506975461', 'image_name': 'tempest-scenario-img--1822925051', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86648) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 04 00:05:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca445a3-234d-485e-b3f8-834ab395f9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929', 'volume_size': 1, 'image_id': '78eb61be-ab7a-4d9c-9cd6-fff506975461', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/78eb61be-ab7a-4d9c-9cd6-fff506975461', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1822925051', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccf8875613644fadbcf6c0369930e12a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '78eb61be-ab7a-4d9c-9cd6-fff506975461', 'created_at': datetime.datetime(2026, 7, 3, 22, 5, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 5, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/78eb61be-ab7a-4d9c-9cd6-fff506975461/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c8aeab0>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22888e83-5827-48b8-ac76-1eddad850184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:46 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Volume volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 (d69e71c4-d36a-43dd-8c08-e24e97ca9929): created successfully
Jul 04 00:05:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22888e83-5827-48b8-ac76-1eddad850184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Flow 'volume_create_manager' (becd4400-ff2f-4e7b-b274-8a283f3afbb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:46 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0b758703-b949-4c96-9f9c-0dc6278be629 tempest-TestInstancesWithCinderVolumes-1794452185 None] Created volume successfully.
Jul 04 00:05:56 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=19,cinder:INSERT=11,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:05:56 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=24,cinder:INSERT=9,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:05:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-14bc448a-8958-4d88-9942-d589eda52c0b req-5c177c89-0cc8-464c-8e11-52e33ab91cf2 tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-14bc448a-8958-4d88-9942-d589eda52c0b req-5c177c89-0cc8-464c-8e11-52e33ab91cf2 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:57 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[587c5dc7-9bb1-4ebc-a980-0477acd800b7]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-14bc448a-8958-4d88-9942-d589eda52c0b req-5c177c89-0cc8-464c-8e11-52e33ab91cf2 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:57 devstack sudo[100617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929
Jul 04 00:05:57 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:58 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-14bc448a-8958-4d88-9942-d589eda52c0b req-5c177c89-0cc8-464c-8e11-52e33ab91cf2 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929" returned: 0 in 0.932s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-14bc448a-8958-4d88-9942-d589eda52c0b req-5c177c89-0cc8-464c-8e11-52e33ab91cf2 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:58 devstack sudo[100621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929
Jul 04 00:05:58 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-14bc448a-8958-4d88-9942-d589eda52c0b req-5c177c89-0cc8-464c-8e11-52e33ab91cf2 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929" returned: 1 in 0.908s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-14bc448a-8958-4d88-9942-d589eda52c0b req-5c177c89-0cc8-464c-8e11-52e33ab91cf2 tempest-TestInstancesWithCinderVolumes-1794452185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:05:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-14bc448a-8958-4d88-9942-d589eda52c0b req-5c177c89-0cc8-464c-8e11-52e33ab91cf2 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.888s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:59 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-14bc448a-8958-4d88-9942-d589eda52c0b req-5c177c89-0cc8-464c-8e11-52e33ab91cf2 tempest-TestInstancesWithCinderVolumes-1794452185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b95b012-c184-44ca-b2f3-10932f52d159', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:05:59 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-14bc448a-8958-4d88-9942-d589eda52c0b req-5c177c89-0cc8-464c-8e11-52e33ab91cf2 tempest-TestInstancesWithCinderVolumes-1794452185 None] attachment_update completed successfully.
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Flow 'volume_create_manager' (b7846ab9-5a28-4f71-bd79-d21bf8c4d597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de14e49-2d91-4219-8b93-ec3b81ced13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de14e49-2d91-4219-8b93-ec3b81ced13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1976103429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb388e6-f2c9-4280-9ddb-ebd9ab281c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d489341b16842c4a7e2d6f5cf5b3be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:06:02Z,use_quota=True,user_id='118c3cd203334c6eaa5258cd21ef7b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad79b423-2669-4567-9def-6a4c34f62ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad79b423-2669-4567-9def-6a4c34f62ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86394e31-a538-4059-b210-12551a91384e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86394e31-a538-4059-b210-12551a91384e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb388e6-f2c9-4280-9ddb-ebd9ab281c75', 'volume_name': 'volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8197555c-c14d-4291-9ee5-04a6ec937d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8197555c-c14d-4291-9ee5-04a6ec937d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4742c9d5-ab5f-4310-9afd-270a0bc3e7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:02 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Volume ebb388e6-f2c9-4280-9ddb-ebd9ab281c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75', 'volume_size': 1}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1976103429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb388e6-f2c9-4280-9ddb-ebd9ab281c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d489341b16842c4a7e2d6f5cf5b3be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:06:02Z,use_quota=True,user_id='118c3cd203334c6eaa5258cd21ef7b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Creating volume ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:06:02 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:06:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:02 devstack sudo[100629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 1073741824
Jul 04 00:06:02 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:03 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 1073741824" returned: 0 in 1.085s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:03 devstack sudo[100706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75
Jul 04 00:06:03 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:04 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" returned: 0 in 1.106s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:04 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] <== create_volume: return (2253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:06:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4742c9d5-ab5f-4310-9afd-270a0bc3e7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ebd5da-6b74-4083-bdaa-10e3ca7d049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:04 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Volume volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 (ebb388e6-f2c9-4280-9ddb-ebd9ab281c75): created successfully
Jul 04 00:06:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ebd5da-6b74-4083-bdaa-10e3ca7d049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Flow 'volume_create_manager' (b7846ab9-5a28-4f71-bd79-d21bf8c4d597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:06:04 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-433b3d4c-ffdb-4dfa-856f-c24946d9f7bd tempest-TestStampPattern-908762194 None] Created volume successfully.
Jul 04 00:06:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:06:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:06:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:06:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:05 devstack sudo[100754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:06:05 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:05 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.802s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:06:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:06:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:06:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Flow 'volume_create_manager' (e1377513-9cf4-4431-93de-e4b1c061c7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502b3709-406f-4b83-8dc8-cc284c2aa690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502b3709-406f-4b83-8dc8-cc284c2aa690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-644620096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dfde0b0-4fc9-4c4b-8835-4f1056128ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0fc31056424c5cb8703f75e21c05c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:06:12Z,use_quota=True,user_id='1ebfd804947c49118a55932142e77207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a0dcdf-c416-4ba2-8f2e-ec7869a8e723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a0dcdf-c416-4ba2-8f2e-ec7869a8e723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97e0e2c-8af7-4d07-b854-79d337d02977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.image.glance [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Creating Keystone auth plugin from conf {{(pid=86648) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f97e0e2c-8af7-4d07-b854-79d337d02977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2dfde0b0-4fc9-4c4b-8835-4f1056128ff3', 'volume_name': 'volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3', 'volume_size': 1, 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c411eeda2924759a25bfc54b8e705a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c870dd0>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc09c45-583d-45ac-b923-5da23b9dfde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc09c45-583d-45ac-b923-5da23b9dfde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b578875c-23f8-4109-8f73-926c7f144e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:12 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Volume 2dfde0b0-4fc9-4c4b-8835-4f1056128ff3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3', 'volume_size': 1, 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c411eeda2924759a25bfc54b8e705a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c870dd0>}
Jul 04 00:06:12 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Trying to clone 2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 from image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc at location (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]). {{(pid=86648) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 04 00:06:13 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 04 00:06:13 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Image download 20.69 MB at 20.69 MB/s
Jul 04 00:06:13 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e62312-d66b-4028-a2aa-013d66368d01]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:13 devstack sudo[101138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD
Jul 04 00:06:13 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:14 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD" returned: 0 in 0.795s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:14 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Temporary image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc is fetched for user 1ebfd804947c49118a55932142e77207. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 04 00:06:14 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e57b012-da75-471a-9f1d-0da26cbc6dcf]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:14 devstack sudo[101198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD
Jul 04 00:06:14 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:15 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD" returned: 0 in 0.825s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-644620096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dfde0b0-4fc9-4c4b-8835-4f1056128ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff0fc31056424c5cb8703f75e21c05c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:06:12Z,use_quota=True,user_id='1ebfd804947c49118a55932142e77207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:06:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Creating volume 2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:06:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:06:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:06:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:06:15 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:06:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:15 devstack sudo[101222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 1073741824
Jul 04 00:06:15 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:16 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 1073741824" returned: 0 in 1.076s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:16 devstack sudo[101229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3
Jul 04 00:06:16 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:17 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" returned: 0 in 0.690s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:06:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:17 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Attempting download of 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc ((None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}])) to volume 2dfde0b0-4fc9-4c4b-8835-4f1056128ff3. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 04 00:06:17 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10175ee-7676-453b-9561-51de1c459ff8]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_dtkdf75z {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:17 devstack sudo[101232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_dtkdf75z
Jul 04 00:06:17 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:18 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_dtkdf75z" returned: 0 in 0.867s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_dtkdf75z {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:18 devstack sudo[101236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_dtkdf75z
Jul 04 00:06:18 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:19 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_dtkdf75z" returned: 1 in 0.991s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_dtkdf75z' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:06:19 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffe8efa-2d7a-474f-b165-49a0ab0b8c90]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:19 devstack sudo[101242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD
Jul 04 00:06:19 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:20 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD" returned: 0 in 1.409s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:20 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc was qcow2, converting to raw {{(pid=86648) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 04 00:06:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:20 devstack sudo[101250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3
Jul 04 00:06:20 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:23 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" returned: 0 in 2.952s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:23 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2a7ef4a1-3d66-41c4-9f37-62a4383d93fc_s9et74qbdevstack@QuobyteHD, size 112.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:06:23 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Converted 112.00 MB image at 37.93 MB/s
Jul 04 00:06:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:23 devstack sudo[101285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 1G
Jul 04 00:06:23 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:24 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 1G" returned: 0 in 1.237s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:24 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d823d1ee-716c-4e47-bde9-e359aeb38611]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:24 devstack sudo[101291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3
Jul 04 00:06:24 devstack sudo[101291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:25 devstack sudo[101291]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" returned: 0 in 1.202s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:26 devstack sudo[101301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3
Jul 04 00:06:26 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:26 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" returned: 1 in 0.924s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:06:26 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Downloaded image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc ((None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}])) to volume 2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 successfully. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 04 00:06:26 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Temporary image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc for user 1ebfd804947c49118a55932142e77207 is deleted. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 04 00:06:26 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Marking volume 2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 as bootable. {{(pid=86648) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 04 00:06:26 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Copying metadata from image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc to 2dfde0b0-4fc9-4c4b-8835-4f1056128ff3. {{(pid=86648) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 04 00:06:26 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Creating volume glance metadata for volume 2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 backed by image 2a7ef4a1-3d66-41c4-9f37-62a4383d93fc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86648) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 04 00:06:26 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b578875c-23f8-4109-8f73-926c7f144e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3', 'volume_size': 1, 'image_id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3c411eeda2924759a25bfc54b8e705a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2a7ef4a1-3d66-41c4-9f37-62a4383d93fc', 'created_at': datetime.datetime(2026, 7, 3, 21, 42, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 42, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a7ef4a1-3d66-41c4-9f37-62a4383d93fc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c870dd0>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7bd885-2500-4593-ad51-4a13c2598d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:27 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Volume volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 (2dfde0b0-4fc9-4c4b-8835-4f1056128ff3): created successfully
Jul 04 00:06:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7bd885-2500-4593-ad51-4a13c2598d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Flow 'volume_create_manager' (e1377513-9cf4-4431-93de-e4b1c061c7cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:06:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cb807791-9e69-4866-a022-b5faedf882ba tempest-TestShelveInstance-2135484327 None] Created volume successfully.
Jul 04 00:06:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-ee12c44c-aa6e-4f34-b3c7-fb6bd76594ac req-d907cf48-3944-464c-8a89-8b2b9f21b971 tempest-TestShelveInstance-2135484327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-ee12c44c-aa6e-4f34-b3c7-fb6bd76594ac req-d907cf48-3944-464c-8a89-8b2b9f21b971 tempest-TestShelveInstance-2135484327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:35 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d80fc89-19b3-4294-b540-4bf303fe4142]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ee12c44c-aa6e-4f34-b3c7-fb6bd76594ac req-d907cf48-3944-464c-8a89-8b2b9f21b971 tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:35 devstack sudo[101406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3
Jul 04 00:06:35 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:35 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ee12c44c-aa6e-4f34-b3c7-fb6bd76594ac req-d907cf48-3944-464c-8a89-8b2b9f21b971 tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" returned: 0 in 0.763s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ee12c44c-aa6e-4f34-b3c7-fb6bd76594ac req-d907cf48-3944-464c-8a89-8b2b9f21b971 tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:36 devstack sudo[101411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3
Jul 04 00:06:36 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:36 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ee12c44c-aa6e-4f34-b3c7-fb6bd76594ac req-d907cf48-3944-464c-8a89-8b2b9f21b971 tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" returned: 1 in 0.740s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-ee12c44c-aa6e-4f34-b3c7-fb6bd76594ac req-d907cf48-3944-464c-8a89-8b2b9f21b971 tempest-TestShelveInstance-2135484327 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:06:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-ee12c44c-aa6e-4f34-b3c7-fb6bd76594ac req-d907cf48-3944-464c-8a89-8b2b9f21b971 tempest-TestShelveInstance-2135484327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.548s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-ee12c44c-aa6e-4f34-b3c7-fb6bd76594ac req-d907cf48-3944-464c-8a89-8b2b9f21b971 tempest-TestShelveInstance-2135484327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8fab36c-d22d-458a-b347-0f04066bfbf6', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:06:36 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-ee12c44c-aa6e-4f34-b3c7-fb6bd76594ac req-d907cf48-3944-464c-8a89-8b2b9f21b971 tempest-TestShelveInstance-2135484327 None] attachment_update completed successfully.
Jul 04 00:06:46 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=19,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=7 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:06:46 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=26,cinder:INSERT=8,cinder:UPDATE=7 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:06:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-63438bc5-7ee2-4cfa-8908-cdc9d849e30a req-0f6288a1-d256-4290-937a-a442dc5e3368 tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-63438bc5-7ee2-4cfa-8908-cdc9d849e30a req-0f6288a1-d256-4290-937a-a442dc5e3368 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:47 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[643279b1-3796-485d-9938-80630a5c6f97]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-63438bc5-7ee2-4cfa-8908-cdc9d849e30a req-0f6288a1-d256-4290-937a-a442dc5e3368 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:47 devstack sudo[101514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b
Jul 04 00:06:47 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:48 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-63438bc5-7ee2-4cfa-8908-cdc9d849e30a req-0f6288a1-d256-4290-937a-a442dc5e3368 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b" returned: 0 in 0.848s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-63438bc5-7ee2-4cfa-8908-cdc9d849e30a req-0f6288a1-d256-4290-937a-a442dc5e3368 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.878s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-63438bc5-7ee2-4cfa-8908-cdc9d849e30a req-0f6288a1-d256-4290-937a-a442dc5e3368 tempest-TestInstancesWithCinderVolumes-1794452185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-a46813e7-380d-4d73-8409-686d122c468b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '317ecc00-f7ff-461f-b625-52173928df1e', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:06:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-63438bc5-7ee2-4cfa-8908-cdc9d849e30a req-0f6288a1-d256-4290-937a-a442dc5e3368 tempest-TestInstancesWithCinderVolumes-1794452185 None] attachment_update completed successfully.
Jul 04 00:06:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-b5a1f768-b566-4225-9ee2-88ec3176293c req-6bc357d4-7c9a-4de9-9e50-288635ade867 tempest-TestStampPattern-908762194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-b5a1f768-b566-4225-9ee2-88ec3176293c req-6bc357d4-7c9a-4de9-9e50-288635ade867 tempest-TestStampPattern-908762194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:49 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8df9a1-5763-4130-8f7e-260e64892452]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-b5a1f768-b566-4225-9ee2-88ec3176293c req-6bc357d4-7c9a-4de9-9e50-288635ade867 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:49 devstack sudo[101529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75
Jul 04 00:06:49 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:50 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-b5a1f768-b566-4225-9ee2-88ec3176293c req-6bc357d4-7c9a-4de9-9e50-288635ade867 tempest-TestStampPattern-908762194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" returned: 0 in 0.783s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-b5a1f768-b566-4225-9ee2-88ec3176293c req-6bc357d4-7c9a-4de9-9e50-288635ade867 tempest-TestStampPattern-908762194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.799s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-b5a1f768-b566-4225-9ee2-88ec3176293c req-6bc357d4-7c9a-4de9-9e50-288635ade867 tempest-TestStampPattern-908762194 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38436953-eb47-4538-9f17-775618d2238a', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:06:50 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-b5a1f768-b566-4225-9ee2-88ec3176293c req-6bc357d4-7c9a-4de9-9e50-288635ade867 tempest-TestStampPattern-908762194 None] attachment_update completed successfully.
Jul 04 00:06:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-1f23af9f-a4ba-4a2e-9fb1-59a3495dc3f6 req-59b05678-832d-48ec-9e98-956189f8b8e5 tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-1f23af9f-a4ba-4a2e-9fb1-59a3495dc3f6 req-59b05678-832d-48ec-9e98-956189f8b8e5 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:55 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f7a74a-a993-482c-baa9-138c2dffcc79]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-1f23af9f-a4ba-4a2e-9fb1-59a3495dc3f6 req-59b05678-832d-48ec-9e98-956189f8b8e5 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:55 devstack sudo[101568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c
Jul 04 00:06:55 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:56 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-1f23af9f-a4ba-4a2e-9fb1-59a3495dc3f6 req-59b05678-832d-48ec-9e98-956189f8b8e5 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c" returned: 0 in 0.855s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-1f23af9f-a4ba-4a2e-9fb1-59a3495dc3f6 req-59b05678-832d-48ec-9e98-956189f8b8e5 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.876s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-1f23af9f-a4ba-4a2e-9fb1-59a3495dc3f6 req-59b05678-832d-48ec-9e98-956189f8b8e5 tempest-TestInstancesWithCinderVolumes-1794452185 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7fd235f9-e0ea-4197-aa1f-4bd5e40bb2eb', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:06:56 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-1f23af9f-a4ba-4a2e-9fb1-59a3495dc3f6 req-59b05678-832d-48ec-9e98-956189f8b8e5 tempest-TestInstancesWithCinderVolumes-1794452185 None] attachment_update completed successfully.
Jul 04 00:06:58 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-4379031f-3414-4c63-8916-bab3afe15a03 req-9111ec38-8cbf-42db-a890-ed5fa2103eef tempest-TestStampPattern-908762194 None] Terminate volume connection completed successfully.
Jul 04 00:06:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-4379031f-3414-4c63-8916-bab3afe15a03 req-9111ec38-8cbf-42db-a890-ed5fa2103eef tempest-TestStampPattern-908762194 None] Deleting attachment 38436953-eb47-4538-9f17-775618d2238a. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:07:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] Creating offline snapshot 7026bdc1-4c16-4c7a-8ccc-c6921b046932 of volume ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:07:00 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b75a17-eac4-49e7-9238-3e23962b176b]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:07:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:01 devstack sudo[101608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75
Jul 04 00:07:01 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:01 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" returned: 0 in 0.834s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:01 devstack sudo[101628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932 1G
Jul 04 00:07:01 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:02 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932 1G" returned: 0 in 0.847s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:02 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932
Jul 04 00:07:02 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:03 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932" returned: 0 in 0.739s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:03 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932 is being set with open permissions: ugo+rw
Jul 04 00:07:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:03 devstack sudo[101652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932
Jul 04 00:07:03 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:04 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932" returned: 0 in 0.736s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:04 devstack sudo[101665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.info
Jul 04 00:07:04 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:04 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.info" returned: 0 in 0.695s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:04 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.info is being set with open permissions: ugo+rw
Jul 04 00:07:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:04 devstack sudo[101668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.info
Jul 04 00:07:04 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:05 devstack sudo[101670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:07:05 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:05 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.info" returned: 0 in 0.761s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.717s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:05 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-84496f21-8b8a-41bc-bd39-db8341ebfa03 tempest-TestStampPattern-908762194 None] Create snapshot completed successfully
Jul 04 00:07:05 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-5d9328f4-9cc1-4f48-8a85-c7486ffc2b47 req-d3084cb8-e4d0-40ca-90d9-80a668848484 tempest-TestInstancesWithCinderVolumes-1794452185 None] Terminate volume connection completed successfully.
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-5d9328f4-9cc1-4f48-8a85-c7486ffc2b47 req-d3084cb8-e4d0-40ca-90d9-80a668848484 tempest-TestInstancesWithCinderVolumes-1794452185 None] Deleting attachment 317ecc00-f7ff-461f-b625-52173928df1e. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:07:05 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.760s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:07:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:07:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "cinder-a46813e7-380d-4d73-8409-686d122c468b-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:07:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "cinder-a46813e7-380d-4d73-8409-686d122c468b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:07:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "cinder-quobyte-a46813e7-380d-4d73-8409-686d122c468b" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:07:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "cinder-quobyte-a46813e7-380d-4d73-8409-686d122c468b" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:07:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8483b126-680f-4c13-ad0e-87a9ba0e8bb2]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:07:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:07 devstack sudo[101687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b
Jul 04 00:07:07 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:08 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b" returned: 0 in 0.796s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:08 devstack sudo[101694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b
Jul 04 00:07:08 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:09 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a46813e7-380d-4d73-8409-686d122c468b" returned: 0 in 0.688s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "cinder-quobyte-a46813e7-380d-4d73-8409-686d122c468b" released by "delete_volume" :: held 1.528s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:07:09 devstack cinder-volume[86648]: WARNING cinder.quota [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2047022476-212152908 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2047022476-212152908, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:07:09 devstack cinder-volume[86648]: WARNING cinder.quota [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2047022476-212152908 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2047022476-212152908, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:07:09 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Created reservations ['41502d40-68c8-4559-8199-744b4e7e6e26', '4adebb65-70bb-46ff-988e-74552a4535c7', '03feb5b6-a42f-4c76-b9cb-64dfa0742f1b', 'aa050884-aa35-45ed-8124-82e6e8a8c9aa'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:07:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:09 devstack sudo[101701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:07:09 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:10 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.651s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:10 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:07:10 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Deleted volume successfully.
Jul 04 00:07:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-bf1f8270-1354-428a-a0de-7ec43e6b07cb tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "cinder-a46813e7-380d-4d73-8409-686d122c468b-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:07:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-c49481c1-454f-4054-85a2-7937288577dc req-1104d57d-e57d-403d-8a4d-9d2e9cad0911 tempest-TestInstancesWithCinderVolumes-1794452185 None] Terminate volume connection completed successfully.
Jul 04 00:07:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-c49481c1-454f-4054-85a2-7937288577dc req-1104d57d-e57d-403d-8a4d-9d2e9cad0911 tempest-TestInstancesWithCinderVolumes-1794452185 None] Deleting attachment 7fd235f9-e0ea-4197-aa1f-4bd5e40bb2eb. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:07:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-a1f5cb14-2951-4445-84b3-18b166483c78 req-fe708063-901f-45ac-b3ec-502adbb33cdf tempest-TestShelveInstance-2135484327 None] Terminate volume connection completed successfully.
Jul 04 00:07:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-a1f5cb14-2951-4445-84b3-18b166483c78 req-fe708063-901f-45ac-b3ec-502adbb33cdf tempest-TestShelveInstance-2135484327 None] Deleting attachment e8fab36c-d22d-458a-b347-0f04066bfbf6. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:07:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "cinder-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:07:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "cinder-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:07:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "cinder-quobyte-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:07:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "cinder-quobyte-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:07:14 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[922e9cbf-f945-48c7-9482-8b81990f9137]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:07:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:14 devstack sudo[101813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c
Jul 04 00:07:14 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:15 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c" returned: 0 in 1.325s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:15 devstack sudo[101823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c
Jul 04 00:07:15 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:16 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c" returned: 0 in 0.853s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "cinder-quobyte-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c" released by "delete_volume" :: held 2.288s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:07:16 devstack cinder-volume[86648]: WARNING cinder.quota [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1342631904-600347026 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1342631904-600347026, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:07:16 devstack cinder-volume[86648]: WARNING cinder.quota [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1342631904-600347026 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1342631904-600347026, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:07:16 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Created reservations ['81d9c98c-a219-4190-a54a-bffdd6f78fdd', 'e851d3bd-f165-438a-bb31-2bf15d884ead', '83cb91b1-e7e1-43e3-951f-f26d81ff52fb', '7a362753-aebb-4ff6-9626-47c036e4087c'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:17 devstack sudo[101827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:07:17 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Flow 'volume_create_manager' (42365af5-dd97-47de-8c1c-984e5c324320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117faff7-72f5-44b4-b1df-4f0f05f33060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (117faff7-72f5-44b4-b1df-4f0f05f33060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-32001738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e22ef7-55dc-4b13-a5c5-5fa8276b1406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d489341b16842c4a7e2d6f5cf5b3be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7026bdc1-4c16-4c7a-8ccc-c6921b046932,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:17Z,use_quota=True,user_id='118c3cd203334c6eaa5258cd21ef7b44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999714bc-360d-4a4f-9d13-69bc2f377c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999714bc-360d-4a4f-9d13-69bc2f377c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5bcd774-7a97-4872-988e-ec8d09348ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5bcd774-7a97-4872-988e-ec8d09348ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16e22ef7-55dc-4b13-a5c5-5fa8276b1406', 'volume_name': 'volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406', 'volume_size': 1, 'snapshot_id': '7026bdc1-4c16-4c7a-8ccc-c6921b046932'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35d3af2-5a14-4027-a139-a95fc86bea5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a35d3af2-5a14-4027-a139-a95fc86bea5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e38f674-420c-44e0-b6c4-f23c81345081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:17 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Volume 16e22ef7-55dc-4b13-a5c5-5fa8276b1406: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406', 'volume_size': 1, 'snapshot_id': '7026bdc1-4c16-4c7a-8ccc-c6921b046932'}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Acquiring lock "cinder-quobyte-7026bdc1-4c16-4c7a-8ccc-c6921b046932-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" by "_create_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Lock "cinder-quobyte-7026bdc1-4c16-4c7a-8ccc-c6921b046932-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Creating volume 16e22ef7-55dc-4b13-a5c5-5fa8276b1406 from snapshot 7026bdc1-4c16-4c7a-8ccc-c6921b046932 {{(pid=86648) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Acquiring lock "cinder-quobyte-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" by "_copy_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Lock "cinder-quobyte-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] snapshot: 7026bdc1-4c16-4c7a-8ccc-c6921b046932, volume: 16e22ef7-55dc-4b13-a5c5-5fa8276b1406,  {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b478272-c6d3-42e4-b346-b8125ddb70af]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:07:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:17 devstack sudo[101829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932
Jul 04 00:07:17 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:18 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.140s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:18 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:07:18 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Deleted volume successfully.
Jul 04 00:07:18 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ca2d587e-3ecb-4385-a1e0-556f6fbfbe0b tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "cinder-6cee9c33-5baf-4505-9fc8-6af3ea9e1f2c-delete_volume" released by "delete_volume" :: held 3.753s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:07:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-bb8eb74f-be97-4a62-8544-dde8d8da2d10 req-eef15e1d-1f2b-4927-a024-c3c1f55cc6f5 tempest-TestShelveInstance-2135484327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:18 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932" returned: 0 in 1.131s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:07:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:07:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Creating direct copy from snapshot {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:07:18 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f923c6c0-596f-4b05-a9a9-fbc7ec46bde6]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:07:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:18 devstack sudo[101845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75
Jul 04 00:07:18 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:19 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" returned: 0 in 0.958s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:19 devstack cinder-volume[86648]: DEBUG cinder.utils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Path /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406 not found in is_blk_device check {{(pid=86648) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:07:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:19 devstack sudo[101857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406
Jul 04 00:07:19 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:23 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-352c37c4-7349-4d4e-a2e1-020abbe4d425 req-a1457903-3ec0-488c-ab77-5283ab22d945 tempest-TestInstancesWithCinderVolumes-1794452185 None] Terminate volume connection completed successfully.
Jul 04 00:07:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-352c37c4-7349-4d4e-a2e1-020abbe4d425 req-a1457903-3ec0-488c-ab77-5283ab22d945 tempest-TestInstancesWithCinderVolumes-1794452185 None] Deleting attachment 4b95b012-c184-44ca-b2f3-10932f52d159. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:07:26 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" returned: 0 in 6.317s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:26 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[433132f9-e9d6-425c-aec6-f3a92199dee8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:07:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:26 devstack sudo[101896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75
Jul 04 00:07:26 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:27 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" returned: 0 in 1.377s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:27 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75, size 1024.00 MB, duration 6.32 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:07:27 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Converted 1024.00 MB image at 162.01 MB/s
Jul 04 00:07:27 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406 is being set with open permissions: ugo+rw
Jul 04 00:07:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:27 devstack sudo[101901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406
Jul 04 00:07:27 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:28 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" returned: 0 in 0.780s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Lock "cinder-quobyte-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" released by "_copy_volume_from_snapshot" :: held 10.743s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Lock "cinder-quobyte-7026bdc1-4c16-4c7a-8ccc-c6921b046932-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" released by "_create_volume_from_snapshot" :: held 10.789s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.822s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-bb8eb74f-be97-4a62-8544-dde8d8da2d10 req-eef15e1d-1f2b-4927-a024-c3c1f55cc6f5 tempest-TestShelveInstance-2135484327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.545s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b436e2a-9c1a-4960-a984-b69c31419d0c]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-bb8eb74f-be97-4a62-8544-dde8d8da2d10 req-eef15e1d-1f2b-4927-a024-c3c1f55cc6f5 tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e38f674-420c-44e0-b6c4-f23c81345081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406', 'volume_size': 1, 'snapshot_id': '7026bdc1-4c16-4c7a-8ccc-c6921b046932'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5986c33-ec0a-4423-855e-c566498085df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:28 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Volume volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406 (16e22ef7-55dc-4b13-a5c5-5fa8276b1406): created successfully
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5986c33-ec0a-4423-855e-c566498085df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Flow 'volume_create_manager' (42365af5-dd97-47de-8c1c-984e5c324320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "cinder-d69e71c4-d36a-43dd-8c08-e24e97ca9929-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "cinder-d69e71c4-d36a-43dd-8c08-e24e97ca9929-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:07:28 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b502af4a-cb7f-4721-ae6f-0381781785c2 tempest-TestStampPattern-908762194 None] Created volume successfully.
Jul 04 00:07:28 devstack sudo[101914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3
Jul 04 00:07:28 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "cinder-quobyte-d69e71c4-d36a-43dd-8c08-e24e97ca9929" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "cinder-quobyte-d69e71c4-d36a-43dd-8c08-e24e97ca9929" acquired by "delete_volume" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4855813c-cd60-4755-84d2-9a74aef91385]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:07:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:28 devstack sudo[101920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929
Jul 04 00:07:28 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:29 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-bb8eb74f-be97-4a62-8544-dde8d8da2d10 req-eef15e1d-1f2b-4927-a024-c3c1f55cc6f5 tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" returned: 0 in 0.891s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-bb8eb74f-be97-4a62-8544-dde8d8da2d10 req-eef15e1d-1f2b-4927-a024-c3c1f55cc6f5 tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:29 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3
Jul 04 00:07:29 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:29 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929" returned: 0 in 0.922s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:29 devstack sudo[101939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929
Jul 04 00:07:29 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:30 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-bb8eb74f-be97-4a62-8544-dde8d8da2d10 req-eef15e1d-1f2b-4927-a024-c3c1f55cc6f5 tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" returned: 1 in 0.888s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-bb8eb74f-be97-4a62-8544-dde8d8da2d10 req-eef15e1d-1f2b-4927-a024-c3c1f55cc6f5 tempest-TestShelveInstance-2135484327 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:07:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-bb8eb74f-be97-4a62-8544-dde8d8da2d10 req-eef15e1d-1f2b-4927-a024-c3c1f55cc6f5 tempest-TestShelveInstance-2135484327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.834s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-bb8eb74f-be97-4a62-8544-dde8d8da2d10 req-eef15e1d-1f2b-4927-a024-c3c1f55cc6f5 tempest-TestShelveInstance-2135484327 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6a150c0-e3b1-4125-a9fe-70d8e3fc317e', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:07:30 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-bb8eb74f-be97-4a62-8544-dde8d8da2d10 req-eef15e1d-1f2b-4927-a024-c3c1f55cc6f5 tempest-TestShelveInstance-2135484327 None] attachment_update completed successfully.
Jul 04 00:07:30 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929" returned: 1 in 0.839s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:07:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:30 devstack sudo[101947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929
Jul 04 00:07:30 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:31 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d69e71c4-d36a-43dd-8c08-e24e97ca9929" returned: 0 in 0.676s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "cinder-quobyte-d69e71c4-d36a-43dd-8c08-e24e97ca9929" released by "delete_volume" :: held 2.514s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:07:31 devstack cinder-volume[86648]: WARNING cinder.quota [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1193002976-1022565788 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1193002976-1022565788, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:07:31 devstack cinder-volume[86648]: WARNING cinder.quota [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1193002976-1022565788 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1193002976-1022565788, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:07:31 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Created reservations ['72f42e3f-31f4-4eb2-9b72-077001259ccd', '05cc0411-6c06-4b09-b9ff-dfcfcfe54480', '746c9b18-5490-4e33-bd6d-b96a4f696f11', '900b5cdb-04c9-408b-a2e9-afcf6dc836c8'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:07:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:31 devstack sudo[101951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:07:31 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:32 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.824s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:32 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:07:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Deleted volume successfully.
Jul 04 00:07:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8789f00c-245c-490c-a9e1-7f66e58ded24 tempest-TestInstancesWithCinderVolumes-1794452185 None] Lock "cinder-d69e71c4-d36a-43dd-8c08-e24e97ca9929-delete_volume" released by "delete_volume" :: held 3.579s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:07:41 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=47,cinder:UPDATE=31,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:07:42 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=50,cinder:UPDATE=37,cinder:DELETE=4,cinder:INSERT=5 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:07:46 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Flow 'volume_create_manager' (462bbb96-5127-4511-995b-d9b0ad4a9260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85450227-9b62-4219-b4c2-8b121808c325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85450227-9b62-4219-b4c2-8b121808c325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-586075874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dc51da-b860-4be3-9d76-1e9a690f9d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295bec1fbf9e4ef3bb0b09488dc68e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:47Z,use_quota=True,user_id='b30ebfa5152b4ee5bb36e402998f2fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c507d16-8dd3-4981-b473-739128f7d89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c507d16-8dd3-4981-b473-739128f7d89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e24abb-a704-44c2-97b1-d1229ca00598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e24abb-a704-44c2-97b1-d1229ca00598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0dc51da-b860-4be3-9d76-1e9a690f9d5e', 'volume_name': 'volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d478cbb-e960-44f9-9ce7-25fd2d8b3718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d478cbb-e960-44f9-9ce7-25fd2d8b3718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fa375b-56b8-4094-8931-68f1393bc032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:47 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume e0dc51da-b860-4be3-9d76-1e9a690f9d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e', 'volume_size': 1}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-586075874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0dc51da-b860-4be3-9d76-1e9a690f9d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295bec1fbf9e4ef3bb0b09488dc68e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:47Z,use_quota=True,user_id='b30ebfa5152b4ee5bb36e402998f2fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Creating volume e0dc51da-b860-4be3-9d76-1e9a690f9d5e {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:07:47 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:47 devstack sudo[102474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e 1073741824
Jul 04 00:07:47 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:47 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e 1073741824" returned: 0 in 0.856s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:48 devstack sudo[102479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e
Jul 04 00:07:48 devstack sudo[102479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:48 devstack sudo[102479]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e" returned: 0 in 0.660s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:07:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6fa375b-56b8-4094-8931-68f1393bc032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197a9125-4637-4666-9855-66962a33917c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:48 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e (e0dc51da-b860-4be3-9d76-1e9a690f9d5e): created successfully
Jul 04 00:07:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197a9125-4637-4666-9855-66962a33917c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Flow 'volume_create_manager' (462bbb96-5127-4511-995b-d9b0ad4a9260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-347bc06a-6509-4e67-9443-dee99f4d5619 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created volume successfully.
Jul 04 00:07:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] Creating offline snapshot aaf30846-3b7b-4122-bacf-ad8c604f216c of volume e0dc51da-b860-4be3-9d76-1e9a690f9d5e {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:07:49 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1b9a8b-4172-434c-b90c-0de09ec87d21]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:07:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:49 devstack sudo[102482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e
Jul 04 00:07:49 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:50 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e" returned: 0 in 0.782s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:50 devstack sudo[102487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c 1G
Jul 04 00:07:50 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:50 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c 1G" returned: 0 in 0.793s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:50 devstack sudo[102493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c
Jul 04 00:07:50 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:51 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c" returned: 0 in 0.666s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:51 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c is being set with open permissions: ugo+rw
Jul 04 00:07:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:51 devstack sudo[102498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c
Jul 04 00:07:51 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:52 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c" returned: 0 in 0.612s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:52 devstack sudo[102501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.info
Jul 04 00:07:52 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:52 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.info" returned: 0 in 0.621s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:52 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.info is being set with open permissions: ugo+rw
Jul 04 00:07:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:52 devstack sudo[102504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.info
Jul 04 00:07:52 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:53 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.info" returned: 0 in 0.640s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.203s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:53 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4d39f686-6453-4798-bad9-795ae845c33d tempest-CreateVolumesFromSnapshotTest-1592716854 None] Create snapshot completed successfully
Jul 04 00:07:54 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:07:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Flow 'volume_create_manager' (a4cf7c19-9fcb-4a1d-aa74-a8ff29c1a547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:54 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963769f7-9b69-47ae-9ac0-4e29fd952330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (963769f7-9b69-47ae-9ac0-4e29fd952330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-971360768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44802100-5d00-41ff-93e4-afd05bd6fcb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295bec1fbf9e4ef3bb0b09488dc68e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:55Z,use_quota=True,user_id='b30ebfa5152b4ee5bb36e402998f2fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd13c48-aa3c-42d2-90e5-8962d7a4f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd13c48-aa3c-42d2-90e5-8962d7a4f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5dbee1-f395-4fd4-8d2e-af95fddbe5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c5dbee1-f395-4fd4-8d2e-af95fddbe5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44802100-5d00-41ff-93e4-afd05bd6fcb7', 'volume_name': 'volume-44802100-5d00-41ff-93e4-afd05bd6fcb7', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5051168b-405f-4d3f-93e4-60770f75714f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5051168b-405f-4d3f-93e4-60770f75714f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58431a35-eba0-45ce-aaef-97ccfd831a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume 44802100-5d00-41ff-93e4-afd05bd6fcb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44802100-5d00-41ff-93e4-afd05bd6fcb7', 'volume_size': 1}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-971360768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44802100-5d00-41ff-93e4-afd05bd6fcb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295bec1fbf9e4ef3bb0b09488dc68e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:55Z,use_quota=True,user_id='b30ebfa5152b4ee5bb36e402998f2fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Creating volume 44802100-5d00-41ff-93e4-afd05bd6fcb7 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:07:55 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-44802100-5d00-41ff-93e4-afd05bd6fcb7 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:55 devstack sudo[102507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-44802100-5d00-41ff-93e4-afd05bd6fcb7 1073741824
Jul 04 00:07:55 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Flow 'volume_create_manager' (fdae0580-4aa3-4c69-8045-546c9b7acd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a6e115-bb33-4cbf-acb3-c8cae1be5aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7a6e115-bb33-4cbf-acb3-c8cae1be5aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1878823120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a7c1a1-6f45-4c88-8ff6-9eb57e664d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295bec1fbf9e4ef3bb0b09488dc68e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:55Z,use_quota=True,user_id='b30ebfa5152b4ee5bb36e402998f2fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712d561a-a7d7-40b2-9f95-ebe405e5457d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712d561a-a7d7-40b2-9f95-ebe405e5457d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc57af6-133c-4830-a834-a4637f1ebdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc57af6-133c-4830-a834-a4637f1ebdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a7c1a1-6f45-4c88-8ff6-9eb57e664d12', 'volume_name': 'volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93eb9986-fc96-4273-ae5d-55c58616f393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93eb9986-fc96-4273-ae5d-55c58616f393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e5e012-fa97-4ef2-a550-ae8b257180de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume 17a7c1a1-6f45-4c88-8ff6-9eb57e664d12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12', 'volume_size': 1}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Flow 'volume_create_manager' (ffa16f3b-1b33-4d2f-9ce1-1ee184a7785d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d32e79b-57a1-4311-b34d-52d249825a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d32e79b-57a1-4311-b34d-52d249825a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1189785860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d26955c-0eb0-487a-8e38-3df04d89c9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295bec1fbf9e4ef3bb0b09488dc68e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:56Z,use_quota=True,user_id='b30ebfa5152b4ee5bb36e402998f2fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b40f4b5-4d5a-4d45-bc81-3a4b13aa38ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b40f4b5-4d5a-4d45-bc81-3a4b13aa38ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f3a908-de0c-4af6-a6f4-4fe24ffd6a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f3a908-de0c-4af6-a6f4-4fe24ffd6a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d26955c-0eb0-487a-8e38-3df04d89c9d3', 'volume_name': 'volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf06605b-019a-4991-aef9-d61b77a10621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf06605b-019a-4991-aef9-d61b77a10621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a13a136-b019-49da-9217-7f890631af3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume 7d26955c-0eb0-487a-8e38-3df04d89c9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3', 'volume_size': 1}
Jul 04 00:07:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:56 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-44802100-5d00-41ff-93e4-afd05bd6fcb7 1073741824" returned: 0 in 1.176s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-44802100-5d00-41ff-93e4-afd05bd6fcb7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:56 devstack sudo[102513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-44802100-5d00-41ff-93e4-afd05bd6fcb7
Jul 04 00:07:56 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Flow 'volume_create_manager' (fe7cbbfb-992b-4bb8-a039-4aee1dd11541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab7de60-5faa-48b5-a32e-b4d00056ceb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab7de60-5faa-48b5-a32e-b4d00056ceb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1302731496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295bec1fbf9e4ef3bb0b09488dc68e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:56Z,use_quota=True,user_id='b30ebfa5152b4ee5bb36e402998f2fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ce30f5-41a9-4466-8a55-c41f1ae63d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ce30f5-41a9-4466-8a55-c41f1ae63d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8544ff5a-0f69-4636-93b8-63a739323ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8544ff5a-0f69-4636-93b8-63a739323ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4', 'volume_name': 'volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83779154-8fa9-43a5-a088-048383f1b746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83779154-8fa9-43a5-a088-048383f1b746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2111cffa-d29b-4cc6-98a1-1339d62c5f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:56 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume 2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4', 'volume_size': 1}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Flow 'volume_create_manager' (046bb4e9-5c15-41c8-a891-c546a8e18dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddb6a59-00c9-4c6f-933c-066741bc9758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddb6a59-00c9-4c6f-933c-066741bc9758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-854070881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a1a7f5-502d-466e-b160-5802728e9cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295bec1fbf9e4ef3bb0b09488dc68e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:57Z,use_quota=True,user_id='b30ebfa5152b4ee5bb36e402998f2fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5528ab8e-0497-471c-9593-16bb442aeacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5528ab8e-0497-471c-9593-16bb442aeacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664730ab-eeeb-434e-a51f-76459be6aa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (664730ab-eeeb-434e-a51f-76459be6aa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97a1a7f5-502d-466e-b160-5802728e9cdf', 'volume_name': 'volume-97a1a7f5-502d-466e-b160-5802728e9cdf', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42a158b-f4ba-41ce-bb90-7358d08b7aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42a158b-f4ba-41ce-bb90-7358d08b7aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368359cb-8f87-40ad-8bf2-e0ea9e20513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:56 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume 97a1a7f5-502d-466e-b160-5802728e9cdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97a1a7f5-502d-466e-b160-5802728e9cdf', 'volume_size': 1}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:56 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-44802100-5d00-41ff-93e4-afd05bd6fcb7" returned: 0 in 0.708s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:07:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.399s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1878823120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a7c1a1-6f45-4c88-8ff6-9eb57e664d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295bec1fbf9e4ef3bb0b09488dc68e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:55Z,use_quota=True,user_id='b30ebfa5152b4ee5bb36e402998f2fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Creating volume 17a7c1a1-6f45-4c88-8ff6-9eb57e664d12 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:07:57 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:57 devstack sudo[102516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12 1073741824
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58431a35-eba0-45ce-aaef-97ccfd831a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44802100-5d00-41ff-93e4-afd05bd6fcb7', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:57 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039e36ab-2c66-4cb7-bc46-8e003302f16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:57 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume volume-44802100-5d00-41ff-93e4-afd05bd6fcb7 (44802100-5d00-41ff-93e4-afd05bd6fcb7): created successfully
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039e36ab-2c66-4cb7-bc46-8e003302f16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Flow 'volume_create_manager' (a4cf7c19-9fcb-4a1d-aa74-a8ff29c1a547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:57 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-190fa7f7-c6e4-4215-b4e1-64392e4f33b6 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created volume successfully.
Jul 04 00:07:57 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12 1073741824" returned: 0 in 0.815s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:57 devstack sudo[102521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12
Jul 04 00:07:57 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:58 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12" returned: 0 in 0.643s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.530s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1189785860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d26955c-0eb0-487a-8e38-3df04d89c9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295bec1fbf9e4ef3bb0b09488dc68e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:56Z,use_quota=True,user_id='b30ebfa5152b4ee5bb36e402998f2fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Creating volume 7d26955c-0eb0-487a-8e38-3df04d89c9d3 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:07:58 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:58 devstack sudo[102524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3 1073741824
Jul 04 00:07:58 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e5e012-fa97-4ef2-a550-ae8b257180de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d763e7d2-1b8f-4e68-aedc-e7ae0c53bd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:58 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12 (17a7c1a1-6f45-4c88-8ff6-9eb57e664d12): created successfully
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d763e7d2-1b8f-4e68-aedc-e7ae0c53bd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Flow 'volume_create_manager' (fdae0580-4aa3-4c69-8045-546c9b7acd39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:58 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-242cc746-2f4c-4b56-8d2b-863e26024aca tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created volume successfully.
Jul 04 00:07:59 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3 1073741824" returned: 0 in 0.959s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:59 devstack sudo[102538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3
Jul 04 00:07:59 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:00 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3" returned: 0 in 0.666s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.732s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1302731496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295bec1fbf9e4ef3bb0b09488dc68e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:56Z,use_quota=True,user_id='b30ebfa5152b4ee5bb36e402998f2fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Creating volume 2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:08:00 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a13a136-b019-49da-9217-7f890631af3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad873a5d-d14b-4d7e-9c30-67d8c2c84c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:00 devstack sudo[102541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4 1073741824
Jul 04 00:08:00 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:00 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3 (7d26955c-0eb0-487a-8e38-3df04d89c9d3): created successfully
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad873a5d-d14b-4d7e-9c30-67d8c2c84c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Flow 'volume_create_manager' (ffa16f3b-1b33-4d2f-9ce1-1ee184a7785d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:00 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cf3325bf-2a75-4fb4-8119-a3a67a1d6370 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created volume successfully.
Jul 04 00:08:01 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4 1073741824" returned: 0 in 0.810s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:01 devstack sudo[102548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4
Jul 04 00:08:01 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:01 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4" returned: 0 in 0.613s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.745s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-854070881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a1a7f5-502d-466e-b160-5802728e9cdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='295bec1fbf9e4ef3bb0b09488dc68e34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:57Z,use_quota=True,user_id='b30ebfa5152b4ee5bb36e402998f2fa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Creating volume 97a1a7f5-502d-466e-b160-5802728e9cdf {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:08:01 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-97a1a7f5-502d-466e-b160-5802728e9cdf 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:01 devstack sudo[102551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-97a1a7f5-502d-466e-b160-5802728e9cdf 1073741824
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2111cffa-d29b-4cc6-98a1-1339d62c5f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:01 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f9062e-b4be-411f-8601-29333e5e7e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:01 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4 (2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4): created successfully
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78f9062e-b4be-411f-8601-29333e5e7e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Flow 'volume_create_manager' (fe7cbbfb-992b-4bb8-a039-4aee1dd11541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:01 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2b048d63-5924-457e-ae5a-b088c9f82127 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created volume successfully.
Jul 04 00:08:02 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-97a1a7f5-502d-466e-b160-5802728e9cdf 1073741824" returned: 0 in 0.880s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-97a1a7f5-502d-466e-b160-5802728e9cdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:02 devstack sudo[102588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-97a1a7f5-502d-466e-b160-5802728e9cdf
Jul 04 00:08:02 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:03 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-97a1a7f5-502d-466e-b160-5802728e9cdf" returned: 0 in 0.611s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368359cb-8f87-40ad-8bf2-e0ea9e20513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97a1a7f5-502d-466e-b160-5802728e9cdf', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894aa115-0ced-4f52-b3ee-4c3d49653784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:03 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Volume volume-97a1a7f5-502d-466e-b160-5802728e9cdf (97a1a7f5-502d-466e-b160-5802728e9cdf): created successfully
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (894aa115-0ced-4f52-b3ee-4c3d49653784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Flow 'volume_create_manager' (046bb4e9-5c15-41c8-a891-c546a8e18dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:03 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-76306099-6ff9-4820-a66e-fc491e62c6f8 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created volume successfully.
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-97a1a7f5-502d-466e-b160-5802728e9cdf-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-97a1a7f5-502d-466e-b160-5802728e9cdf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-quobyte-97a1a7f5-502d-466e-b160-5802728e9cdf" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-97a1a7f5-502d-466e-b160-5802728e9cdf" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdb1b47-7777-4b6a-a492-0d007c771c36]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-97a1a7f5-502d-466e-b160-5802728e9cdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:03 devstack sudo[102592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-97a1a7f5-502d-466e-b160-5802728e9cdf
Jul 04 00:08:03 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:04 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-97a1a7f5-502d-466e-b160-5802728e9cdf" returned: 0 in 0.720s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-97a1a7f5-502d-466e-b160-5802728e9cdf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:04 devstack sudo[102597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-97a1a7f5-502d-466e-b160-5802728e9cdf
Jul 04 00:08:04 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:04 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-97a1a7f5-502d-466e-b160-5802728e9cdf" returned: 0 in 0.653s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-97a1a7f5-502d-466e-b160-5802728e9cdf" released by "delete_volume" :: held 1.410s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:04 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created reservations ['6f891c25-3287-4520-bd0a-3d83e95eb493', '883115d3-6f90-4a3a-82af-05a39231a0ef', '528bd7a7-6120-4074-bff1-c90c9b6cf0f0', '22d9012f-e8af-4b03-8ced-22401b1a1ba2'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:05 devstack sudo[102600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:05 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:05 devstack sudo[102602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:05 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-72fa4905-59cd-4ca3-816e-0631a0bade8a req-338d367c-a70a-4af8-82f4-9730f3e26f0a tempest-TestStampPattern-908762194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-72fa4905-59cd-4ca3-816e-0631a0bade8a req-338d367c-a70a-4af8-82f4-9730f3e26f0a tempest-TestStampPattern-908762194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e52a55-289a-4f75-8f93-3910732d0d4e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-72fa4905-59cd-4ca3-816e-0631a0bade8a req-338d367c-a70a-4af8-82f4-9730f3e26f0a tempest-TestStampPattern-908762194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:05 devstack sudo[102613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406
Jul 04 00:08:05 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:05 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.720s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:05 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Deleted volume successfully.
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-quobyte-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f690712a-31ea-4e42-bb68-ad1cf4557952 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-97a1a7f5-502d-466e-b160-5802728e9cdf-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[83485c86-6961-4659-80d1-7976b0314ea7]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:05 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.717s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:08:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:08:05 devstack sudo[102618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4
Jul 04 00:08:05 devstack sudo[102618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:06 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-72fa4905-59cd-4ca3-816e-0631a0bade8a req-338d367c-a70a-4af8-82f4-9730f3e26f0a tempest-TestStampPattern-908762194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" returned: 0 in 0.892s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-72fa4905-59cd-4ca3-816e-0631a0bade8a req-338d367c-a70a-4af8-82f4-9730f3e26f0a tempest-TestStampPattern-908762194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.908s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-72fa4905-59cd-4ca3-816e-0631a0bade8a req-338d367c-a70a-4af8-82f4-9730f3e26f0a tempest-TestStampPattern-908762194 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1', 'name': 'volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d97016f-cadb-415d-adeb-e2298b1a03de', 'enforce_multipath': True} {{(pid=86648) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:08:06 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-72fa4905-59cd-4ca3-816e-0631a0bade8a req-338d367c-a70a-4af8-82f4-9730f3e26f0a tempest-TestStampPattern-908762194 None] attachment_update completed successfully.
Jul 04 00:08:06 devstack sudo[102618]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4" returned: 0 in 0.870s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:06 devstack sudo[102626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4
Jul 04 00:08:06 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:07 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4" returned: 0 in 0.661s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4" released by "delete_volume" :: held 1.582s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:07 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created reservations ['13875feb-24f6-45c7-b853-d955d91d2090', '94692868-55e1-45f8-a1d5-dd27612bcf95', '512f507d-5c9d-4fda-812f-7942a48aae2a', 'b2eb51a2-2e50-4045-b0fb-0647e94c68f0'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:07 devstack sudo[102634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:07 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-7d26955c-0eb0-487a-8e38-3df04d89c9d3-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-7d26955c-0eb0-487a-8e38-3df04d89c9d3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-quobyte-7d26955c-0eb0-487a-8e38-3df04d89c9d3" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-7d26955c-0eb0-487a-8e38-3df04d89c9d3" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:08 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5940848-1d24-4649-bae0-97bf7dfcb5ef]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:08 devstack sudo[102636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3
Jul 04 00:08:08 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:08 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.633s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:08 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:08 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Deleted volume successfully.
Jul 04 00:08:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8879b824-ea43-4ede-9883-159876b06f68 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-2ebdc23b-7e72-40dd-80c8-6b753eb4c7d4-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:08 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3" returned: 0 in 0.756s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:08 devstack sudo[102643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3
Jul 04 00:08:08 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:09 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7d26955c-0eb0-487a-8e38-3df04d89c9d3" returned: 0 in 0.648s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-7d26955c-0eb0-487a-8e38-3df04d89c9d3" released by "delete_volume" :: held 1.456s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:09 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created reservations ['330ba898-db04-4a25-9be5-33c889e9d113', '8bb20d38-1515-43a6-a97d-12bf3c025e70', '3022b3a6-06de-4972-9769-a20129839069', '38c9919c-cb07-4381-b7b1-00c1a21cbdb7'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:09 devstack sudo[102650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:09 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-quobyte-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12" acquired by "delete_volume" :: waited 0.038s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:10 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.796s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:10 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:10 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Deleted volume successfully.
Jul 04 00:08:10 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[182f786a-ec31-4326-ac1e-1198185556c3]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-ef0a75e0-fa11-4d57-8cbf-31ee8725e58a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-7d26955c-0eb0-487a-8e38-3df04d89c9d3-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:10 devstack sudo[102655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12
Jul 04 00:08:10 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:11 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12" returned: 0 in 0.863s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:11 devstack sudo[102677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12
Jul 04 00:08:11 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:11 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12" returned: 0 in 0.682s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12" released by "delete_volume" :: held 1.610s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created reservations ['e160276a-e397-4fc3-bc1a-d72f2f935001', 'aabeb826-dbcf-4ea5-8f5f-40150a88176b', 'c214a075-db98-4082-9737-89b04bef80d2', '3bd8579d-f8de-4e77-b330-684c0aa4d4eb'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:12 devstack sudo[102684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:12 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-44802100-5d00-41ff-93e4-afd05bd6fcb7-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-44802100-5d00-41ff-93e4-afd05bd6fcb7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-quobyte-44802100-5d00-41ff-93e4-afd05bd6fcb7" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-44802100-5d00-41ff-93e4-afd05bd6fcb7" acquired by "delete_volume" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[58586b3a-4f68-4a7c-b3a4-2c0e50e35e95]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-44802100-5d00-41ff-93e4-afd05bd6fcb7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:12 devstack sudo[102703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-44802100-5d00-41ff-93e4-afd05bd6fcb7
Jul 04 00:08:12 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-d806413f-0850-4dbd-a5d7-320792d0a33d req-6f42a44e-45e9-47d1-88d9-a299ec8203d3 tempest-TestStampPattern-908762194 None] Terminate volume connection completed successfully.
Jul 04 00:08:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-d806413f-0850-4dbd-a5d7-320792d0a33d req-6f42a44e-45e9-47d1-88d9-a299ec8203d3 tempest-TestStampPattern-908762194 None] Deleting attachment 3d97016f-cadb-415d-adeb-e2298b1a03de. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:08:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.087s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:13 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:13 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Deleted volume successfully.
Jul 04 00:08:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f15c909d-321f-440c-84fe-da8024c52612 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-17a7c1a1-6f45-4c88-8ff6-9eb57e664d12-delete_volume" released by "delete_volume" :: held 3.003s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:13 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-44802100-5d00-41ff-93e4-afd05bd6fcb7" returned: 0 in 1.052s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-44802100-5d00-41ff-93e4-afd05bd6fcb7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:13 devstack sudo[102715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-44802100-5d00-41ff-93e4-afd05bd6fcb7
Jul 04 00:08:13 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:14 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-44802100-5d00-41ff-93e4-afd05bd6fcb7" returned: 0 in 0.632s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-44802100-5d00-41ff-93e4-afd05bd6fcb7" released by "delete_volume" :: held 1.746s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created reservations ['42fa04f7-5c36-4314-97ae-0054aced44ad', 'e3c8c818-d90b-4e33-abf6-c8f60424c60b', 'e4d41d04-7b59-4f8d-9441-6ca59598e062', '976601df-5f7c-4c65-86c2-303121dcaaad'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:14 devstack sudo[102718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:14 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:14 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-38586e71-3ac2-4357-a469-cb213dcde388 tempest-TestShelveInstance-2135484327 None] Terminate volume connection completed successfully.
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-38586e71-3ac2-4357-a469-cb213dcde388 tempest-TestShelveInstance-2135484327 None] Deleting attachment f6a150c0-e3b1-4125-a9fe-70d8e3fc317e. {{(pid=86648) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-aaf30846-3b7b-4122-bacf-ad8c604f216c-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-aaf30846-3b7b-4122-bacf-ad8c604f216c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-quobyte-e0dc51da-b860-4be3-9d76-1e9a690f9d5e" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-e0dc51da-b860-4be3-9d76-1e9a690f9d5e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-quobyte-aaf30846-3b7b-4122-bacf-ad8c604f216c" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-aaf30846-3b7b-4122-bacf-ad8c604f216c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Deleting offline snapshot aaf30846-3b7b-4122-bacf-ad8c604f216c of volume e0dc51da-b860-4be3-9d76-1e9a690f9d5e {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] snapshot_file for this snap is: volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d171bf0-165c-4021-8721-ba5394598ae5]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:15 devstack sudo[102720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c
Jul 04 00:08:15 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:15 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.727s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:15 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:15 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Deleted volume successfully.
Jul 04 00:08:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b9531cf7-0cef-4e47-8529-4fc84c7931c7 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-44802100-5d00-41ff-93e4-afd05bd6fcb7-delete_volume" released by "delete_volume" :: held 2.734s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Acquiring lock "cinder-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Lock "cinder-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Acquiring lock "cinder-quobyte-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Lock "cinder-quobyte-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" acquired by "delete_volume" :: waited 0.037s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:15 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dccb74-362d-424b-a82a-25b30bed6b1c]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:15 devstack sudo[102757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3
Jul 04 00:08:15 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:16 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c" returned: 0 in 1.195s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:08:16 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded8b78d-9227-47f7-b75c-afa0a4c01c3a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:16 devstack sudo[102766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e
Jul 04 00:08:16 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:16 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" returned: 0 in 1.042s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:16 devstack sudo[102770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3
Jul 04 00:08:16 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:17 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e" returned: 0 in 0.910s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:17 devstack sudo[102775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c
Jul 04 00:08:17 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:17 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" returned: 1 in 0.839s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:08:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:17 devstack sudo[102781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3
Jul 04 00:08:17 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:17 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c" returned: 0 in 0.789s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:17 devstack sudo[102790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c
Jul 04 00:08:17 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:18 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" returned: 0 in 0.667s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Lock "cinder-quobyte-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3" released by "delete_volume" :: held 2.696s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG cinder.quota [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Created reservations ['fcda73a9-8c96-47e5-9183-65d2d603b1fa', '19da53e1-8c4e-46ed-8629-a026d7b768e8', 'bc1ef5c1-d300-4276-8114-824cb23ef9dc', '9c685756-f397-486f-9585-ce5818c7be4c'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:18 devstack sudo[102806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:18 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:18 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e.aaf30846-3b7b-4122-bacf-ad8c604f216c" returned: 0 in 0.935s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-aaf30846-3b7b-4122-bacf-ad8c604f216c" released by "_delete_snapshot" :: held 3.997s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-e0dc51da-b860-4be3-9d76-1e9a690f9d5e" released by "delete_snapshot" :: held 4.028s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:18 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created reservations ['4ca95a06-2100-4845-9fa7-94e41ee4b12b', '7da05cba-fa1e-4d90-8845-d9f6dabd3ca5', 'b05cc174-1983-497d-9f7f-afc1554742f0', 'a5e9d644-6586-4bd3-85cd-e36721a78006'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:19 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Delete snapshot completed successfully.
Jul 04 00:08:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-be92ed6a-60fc-478b-bdaf-63b371061bf1 tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-aaf30846-3b7b-4122-bacf-ad8c604f216c-delete_snapshot" released by "delete_snapshot" :: held 4.284s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-e0dc51da-b860-4be3-9d76-1e9a690f9d5e-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-e0dc51da-b860-4be3-9d76-1e9a690f9d5e-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "cinder-quobyte-e0dc51da-b860-4be3-9d76-1e9a690f9d5e" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-e0dc51da-b860-4be3-9d76-1e9a690f9d5e" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:19 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.043s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:19 devstack cinder-volume[86648]: DEBUG cinder.manager [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:19 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e05812-6537-41d3-a068-162f722b5c45]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:19 devstack cinder-volume[86648]: INFO cinder.volume.manager [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Deleted volume successfully.
Jul 04 00:08:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [req-c9ee8eb2-7918-4313-ba7c-e9fae59ab512 req-127d920d-fd43-44f8-8007-a91ed01bcf00 tempest-TestShelveInstance-2135484327 None] Lock "cinder-2dfde0b0-4fc9-4c4b-8835-4f1056128ff3-delete_volume" released by "delete_volume" :: held 4.090s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:19 devstack sudo[102816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e
Jul 04 00:08:19 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:20 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e" returned: 0 in 0.903s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:20 devstack sudo[102823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e
Jul 04 00:08:20 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:21 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e0dc51da-b860-4be3-9d76-1e9a690f9d5e" returned: 0 in 0.666s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-quobyte-e0dc51da-b860-4be3-9d76-1e9a690f9d5e" released by "delete_volume" :: held 1.670s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:21 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Created reservations ['6a0082d8-44bd-460f-8a03-9e7e70b194cc', '6372a755-646d-4c48-bae6-4f7671ec027c', '4fc6a88c-cf99-40b8-afa2-f3233a02e657', '89796788-6130-406a-b56c-fe31676a5f12'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:21 devstack sudo[102828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:21 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:21 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.734s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:21 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:21 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Deleted volume successfully.
Jul 04 00:08:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-caefdfaa-fb00-4dba-bcd8-ba8d123ce71a tempest-CreateVolumesFromSnapshotTest-1592716854 None] Lock "cinder-e0dc51da-b860-4be3-9d76-1e9a690f9d5e-delete_volume" released by "delete_volume" :: held 2.657s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Acquiring lock "cinder-16e22ef7-55dc-4b13-a5c5-5fa8276b1406-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Lock "cinder-16e22ef7-55dc-4b13-a5c5-5fa8276b1406-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Acquiring lock "cinder-quobyte-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Lock "cinder-quobyte-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:23 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ef89d6-cb86-495e-bf0c-66c8f3f9f661]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:23 devstack sudo[102832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406
Jul 04 00:08:23 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:24 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" returned: 0 in 0.871s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:24 devstack sudo[102837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406
Jul 04 00:08:24 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:24 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:08:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Flow 'volume_create_manager' (0b83aa5e-ed5d-435f-86b3-c35a3cb6f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3182e0-09ce-467e-bb7a-bbaffd654589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd3182e0-09ce-467e-bb7a-bbaffd654589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-748210242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51213f15-b36c-48a0-acde-a3f25c8ffb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75c254608fa462493f2c4912981ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:25Z,use_quota=True,user_id='f9890f17a3b04b23bb66790d2a2f0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c756158-854c-4b27-b0ec-a8167d03ff9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c756158-854c-4b27-b0ec-a8167d03ff9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a27da87-f651-4eea-9277-355adcc114ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a27da87-f651-4eea-9277-355adcc114ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51213f15-b36c-48a0-acde-a3f25c8ffb76', 'volume_name': 'volume-51213f15-b36c-48a0-acde-a3f25c8ffb76', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5848203-db1b-44ff-9c2d-ed87c1f59f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5848203-db1b-44ff-9c2d-ed87c1f59f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f6e597-4faa-4ab4-b607-214867fc4d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:25 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume 51213f15-b36c-48a0-acde-a3f25c8ffb76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51213f15-b36c-48a0-acde-a3f25c8ffb76', 'volume_size': 1}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-748210242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51213f15-b36c-48a0-acde-a3f25c8ffb76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75c254608fa462493f2c4912981ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:25Z,use_quota=True,user_id='f9890f17a3b04b23bb66790d2a2f0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Creating volume 51213f15-b36c-48a0-acde-a3f25c8ffb76 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:08:25 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-51213f15-b36c-48a0-acde-a3f25c8ffb76 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:25 devstack sudo[102840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-51213f15-b36c-48a0-acde-a3f25c8ffb76 1073741824
Jul 04 00:08:25 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:25 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" returned: 0 in 0.772s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Lock "cinder-quobyte-16e22ef7-55dc-4b13-a5c5-5fa8276b1406" released by "delete_volume" :: held 1.692s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Created reservations ['8a10a097-4fbc-4003-9310-7d3ab46fdb83', '78b7004b-09ed-4bde-be97-524c54704ec7', 'a4ff4698-ae09-4111-b48a-bc4ee77e9f49', '843dd0a7-4879-4231-8498-c1057293edf0'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:25 devstack sudo[102849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:25 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:26 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-51213f15-b36c-48a0-acde-a3f25c8ffb76 1073741824" returned: 0 in 1.036s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-51213f15-b36c-48a0-acde-a3f25c8ffb76 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:26 devstack sudo[102858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-51213f15-b36c-48a0-acde-a3f25c8ffb76
Jul 04 00:08:26 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Acquiring lock "cinder-7026bdc1-4c16-4c7a-8ccc-c6921b046932-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Lock "cinder-7026bdc1-4c16-4c7a-8ccc-c6921b046932-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Acquiring lock "cinder-quobyte-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Lock "cinder-quobyte-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Acquiring lock "cinder-quobyte-7026bdc1-4c16-4c7a-8ccc-c6921b046932" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:26 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Lock "cinder-quobyte-7026bdc1-4c16-4c7a-8ccc-c6921b046932" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Deleting offline snapshot 7026bdc1-4c16-4c7a-8ccc-c6921b046932 of volume ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] snapshot_file for this snap is: volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.862s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:26 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Deleted volume successfully.
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02b760b-a496-402f-9009-fedf77442860]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-61492719-d6a7-4eae-94e0-f4ea63de63e4 tempest-TestStampPattern-908762194 None] Lock "cinder-16e22ef7-55dc-4b13-a5c5-5fa8276b1406-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:26 devstack sudo[102860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932
Jul 04 00:08:26 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:26 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-51213f15-b36c-48a0-acde-a3f25c8ffb76" returned: 0 in 0.847s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:08:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.944s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3f6e597-4faa-4ab4-b607-214867fc4d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51213f15-b36c-48a0-acde-a3f25c8ffb76', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aedf456-44b9-4c0a-9aea-5d787cfab390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:27 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume volume-51213f15-b36c-48a0-acde-a3f25c8ffb76 (51213f15-b36c-48a0-acde-a3f25c8ffb76): created successfully
Jul 04 00:08:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aedf456-44b9-4c0a-9aea-5d787cfab390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Flow 'volume_create_manager' (0b83aa5e-ed5d-435f-86b3-c35a3cb6f382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e025c143-da52-44e2-b0e9-038e485e7712 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Created volume successfully.
Jul 04 00:08:27 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932" returned: 0 in 0.876s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:08:27 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a444f45-dddc-44d3-85b3-da37a9336971]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:27 devstack sudo[102866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75
Jul 04 00:08:27 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:28 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" returned: 0 in 0.774s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:28 devstack sudo[102872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932
Jul 04 00:08:28 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Flow 'volume_create_manager' (0fef6598-daa9-4b9f-a555-182f7eb00e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e05bdef-dea7-4adc-a4a7-38267d5fa5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e05bdef-dea7-4adc-a4a7-38267d5fa5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-637022906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ee77e7-bbb7-48ce-a589-2b6a6effac0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75c254608fa462493f2c4912981ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:29Z,use_quota=True,user_id='f9890f17a3b04b23bb66790d2a2f0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a14489b-c911-4098-baff-38eed335f9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a14489b-c911-4098-baff-38eed335f9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8b9cff-1fec-47fe-925e-9921c08db847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a8b9cff-1fec-47fe-925e-9921c08db847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ee77e7-bbb7-48ce-a589-2b6a6effac0f', 'volume_name': 'volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d1f939-ee40-45c2-8bd2-c9cc5f5d3455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d1f939-ee40-45c2-8bd2-c9cc5f5d3455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1794bfb3-90f8-45f7-91d8-411ac4d1fc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:28 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume 66ee77e7-bbb7-48ce-a589-2b6a6effac0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f', 'volume_size': 1}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-637022906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ee77e7-bbb7-48ce-a589-2b6a6effac0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75c254608fa462493f2c4912981ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:29Z,use_quota=True,user_id='f9890f17a3b04b23bb66790d2a2f0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Creating volume 66ee77e7-bbb7-48ce-a589-2b6a6effac0f {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:08:28 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:08:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:28 devstack sudo[102878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f 1073741824
Jul 04 00:08:28 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:29 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932" returned: 0 in 0.916s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:29 devstack sudo[102880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932
Jul 04 00:08:29 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Flow 'volume_create_manager' (6ebe9513-50a7-4b24-894e-90f570b741e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f07f6ff-5c2a-4ad9-9894-9708bf6ebda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f07f6ff-5c2a-4ad9-9894-9708bf6ebda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246128789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1839c8b1-9534-492f-8900-1bfdd98d57f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75c254608fa462493f2c4912981ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:29Z,use_quota=True,user_id='f9890f17a3b04b23bb66790d2a2f0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0694ae-b19e-4c69-a772-bc5418f0206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c0694ae-b19e-4c69-a772-bc5418f0206a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beab789a-edbb-49ee-9088-f7bd41a8c4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beab789a-edbb-49ee-9088-f7bd41a8c4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1839c8b1-9534-492f-8900-1bfdd98d57f7', 'volume_name': 'volume-1839c8b1-9534-492f-8900-1bfdd98d57f7', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5181aed5-9f53-4a9f-abe3-06a07e9c965e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5181aed5-9f53-4a9f-abe3-06a07e9c965e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f6af8e-4559-4cdb-a371-a161412dc590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:29 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume 1839c8b1-9534-492f-8900-1bfdd98d57f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1839c8b1-9534-492f-8900-1bfdd98d57f7', 'volume_size': 1}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Flow 'volume_create_manager' (838a8b14-09dc-482e-bf6b-318be8d873c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08af31db-af89-45f0-87f5-032be84fed94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08af31db-af89-45f0-87f5-032be84fed94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1847424470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209a0ee8-75d6-43e7-a840-2cd2ded5f535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75c254608fa462493f2c4912981ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:30Z,use_quota=True,user_id='f9890f17a3b04b23bb66790d2a2f0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde17a99-f488-452a-b847-89920edf1405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde17a99-f488-452a-b847-89920edf1405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d119048f-db50-46dc-ba2e-00e9bc602832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d119048f-db50-46dc-ba2e-00e9bc602832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209a0ee8-75d6-43e7-a840-2cd2ded5f535', 'volume_name': 'volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57196898-ee7f-47fa-a8ee-bfca2c7c4aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57196898-ee7f-47fa-a8ee-bfca2c7c4aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccfb01c1-c427-4ad5-9652-1764ec1f99d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:29 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume 209a0ee8-75d6-43e7-a840-2cd2ded5f535: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535', 'volume_size': 1}
Jul 04 00:08:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:30 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f 1073741824" returned: 0 in 1.187s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:30 devstack sudo[102887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f
Jul 04 00:08:30 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:30 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75.7026bdc1-4c16-4c7a-8ccc-c6921b046932" returned: 0 in 1.190s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Lock "cinder-quobyte-7026bdc1-4c16-4c7a-8ccc-c6921b046932" released by "_delete_snapshot" :: held 3.939s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Lock "cinder-quobyte-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" released by "delete_snapshot" :: held 3.985s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Created reservations ['965b0c23-87b2-487d-af99-ddbd185ca4ef', '9d9fe2dd-a69d-4979-923e-84685a58d494', 'e12f29ba-3e3c-41c4-8fb4-0c915d99eddf', 'b59d6274-074a-48b2-83dd-58e61ccaaf77'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Flow 'volume_create_manager' (2eb7e5f8-7bc6-4f97-b738-3c8cfceb3555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08967957-8be5-4d34-8ade-5bb8d4e8b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08967957-8be5-4d34-8ade-5bb8d4e8b385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1493109152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75c254608fa462493f2c4912981ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:30Z,use_quota=True,user_id='f9890f17a3b04b23bb66790d2a2f0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01735bfe-829f-403b-aadb-f6e495b64b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01735bfe-829f-403b-aadb-f6e495b64b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f3749a-d93f-4c2f-be9d-8eadd7244342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4f3749a-d93f-4c2f-be9d-8eadd7244342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e', 'volume_name': 'volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576080d8-e839-4518-8afd-a95165c6389b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576080d8-e839-4518-8afd-a95165c6389b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a19b397-ec51-4632-8ed6-a8667b3b7798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:30 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e', 'volume_size': 1}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:30 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Delete snapshot completed successfully.
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-89f1858c-d314-4b98-8385-7cd1eb41789c tempest-TestStampPattern-908762194 None] Lock "cinder-7026bdc1-4c16-4c7a-8ccc-c6921b046932-delete_snapshot" released by "delete_snapshot" :: held 4.322s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:08:30 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Flow 'volume_create_manager' (6fb3a05f-9963-4cf2-9aa2-3e65a2c2bb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3505873d-a45a-49e1-b605-e220923629a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f" returned: 0 in 0.825s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.582s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-246128789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1839c8b1-9534-492f-8900-1bfdd98d57f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75c254608fa462493f2c4912981ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:29Z,use_quota=True,user_id='f9890f17a3b04b23bb66790d2a2f0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Creating volume 1839c8b1-9534-492f-8900-1bfdd98d57f7 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:08:30 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1839c8b1-9534-492f-8900-1bfdd98d57f7 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3505873d-a45a-49e1-b605-e220923629a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-131736355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e860e5eb-d459-43eb-8def-13c147117b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75c254608fa462493f2c4912981ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:31Z,use_quota=True,user_id='f9890f17a3b04b23bb66790d2a2f0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff64685f-bcba-49ad-a3c4-dc3df6bf93e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:30 devstack sudo[102891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1839c8b1-9534-492f-8900-1bfdd98d57f7 1073741824
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff64685f-bcba-49ad-a3c4-dc3df6bf93e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:30 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee7e26b-de50-4ca4-b0da-4827d1e6c4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee7e26b-de50-4ca4-b0da-4827d1e6c4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e860e5eb-d459-43eb-8def-13c147117b66', 'volume_name': 'volume-e860e5eb-d459-43eb-8def-13c147117b66', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1d8bdb-c35b-46b1-8e41-db34c447e2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1d8bdb-c35b-46b1-8e41-db34c447e2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5b36bf-f163-4a45-b0e7-ebf6291b9b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:30 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume e860e5eb-d459-43eb-8def-13c147117b66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e860e5eb-d459-43eb-8def-13c147117b66', 'volume_size': 1}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1794bfb3-90f8-45f7-91d8-411ac4d1fc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547a0dbd-b463-4822-baf5-00720695c80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:31 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f (66ee77e7-bbb7-48ce-a589-2b6a6effac0f): created successfully
Jul 04 00:08:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547a0dbd-b463-4822-baf5-00720695c80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Flow 'volume_create_manager' (0fef6598-daa9-4b9f-a555-182f7eb00e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:31 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6c50e9cb-234a-4bc5-befa-c42bb6b87336 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Created volume successfully.
Jul 04 00:08:31 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1839c8b1-9534-492f-8900-1bfdd98d57f7 1073741824" returned: 0 in 1.008s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1839c8b1-9534-492f-8900-1bfdd98d57f7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:31 devstack sudo[102896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1839c8b1-9534-492f-8900-1bfdd98d57f7
Jul 04 00:08:31 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:32 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1839c8b1-9534-492f-8900-1bfdd98d57f7" returned: 0 in 0.814s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.850s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1847424470',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209a0ee8-75d6-43e7-a840-2cd2ded5f535,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75c254608fa462493f2c4912981ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:30Z,use_quota=True,user_id='f9890f17a3b04b23bb66790d2a2f0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Creating volume 209a0ee8-75d6-43e7-a840-2cd2ded5f535 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:08:32 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f6af8e-4559-4cdb-a371-a161412dc590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1839c8b1-9534-492f-8900-1bfdd98d57f7', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:32 devstack sudo[102901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535 1073741824
Jul 04 00:08:32 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5917fb-21a2-4966-9f04-105f8d877122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:32 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume volume-1839c8b1-9534-492f-8900-1bfdd98d57f7 (1839c8b1-9534-492f-8900-1bfdd98d57f7): created successfully
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5917fb-21a2-4966-9f04-105f8d877122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Flow 'volume_create_manager' (6ebe9513-50a7-4b24-894e-90f570b741e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0ca476b6-5c05-40da-82f1-15584cb2e14f tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Created volume successfully.
Jul 04 00:08:33 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535 1073741824" returned: 0 in 1.012s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:33 devstack sudo[102910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535
Jul 04 00:08:33 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:34 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535" returned: 0 in 0.866s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.933s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.215s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1493109152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75c254608fa462493f2c4912981ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:30Z,use_quota=True,user_id='f9890f17a3b04b23bb66790d2a2f0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Creating volume b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:08:34 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:34 devstack sudo[102932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e 1073741824
Jul 04 00:08:34 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccfb01c1-c427-4ad5-9652-1764ec1f99d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bc16e1-5835-49c0-85af-3fee97fa8146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:34 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535 (209a0ee8-75d6-43e7-a840-2cd2ded5f535): created successfully
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12bc16e1-5835-49c0-85af-3fee97fa8146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Flow 'volume_create_manager' (838a8b14-09dc-482e-bf6b-318be8d873c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c8863772-7051-4d8f-abe5-40e5d8a652b6 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Created volume successfully.
Jul 04 00:08:35 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e 1073741824" returned: 0 in 1.156s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:35 devstack sudo[102941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e
Jul 04 00:08:35 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Flow 'volume_create_manager' (d1fe50cf-1e7e-4bde-b217-cc4662c28a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970bf973-3d3d-4bab-8e1c-9acffa696368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (970bf973-3d3d-4bab-8e1c-9acffa696368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbaced7f-5449-4757-8209-4f341c99ac90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461566c53a96455a8899f24de6549c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:36Z,use_quota=True,user_id='a0077abf15134660857ef41b5ae4f086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffe3477f-9079-4fbd-aea7-cd062239ff47),volume_type_id=ffe3477f-9079-4fbd-aea7-cd062239ff47)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560d0222-a8c0-43c6-a86c-d89627961b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560d0222-a8c0-43c6-a86c-d89627961b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a301f52-530a-496d-863b-d9d44cb9aa9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.image.glance [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Creating Keystone auth plugin from conf {{(pid=86648) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a301f52-530a-496d-863b-d9d44cb9aa9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bbaced7f-5449-4757-8209-4f341c99ac90', 'volume_name': 'volume-bbaced7f-5449-4757-8209-4f341c99ac90', 'volume_size': 1, 'image_id': '57b53a4c-4039-4199-a61e-2021efbe7428', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b53a4c-4039-4199-a61e-2021efbe7428', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6a784ac86004cb4b8e5d9829777e385f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '461566c53a96455a8899f24de6549c64', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a809d3953da57bbe16cfa068ac06d7916bb7cab50a59ce892c71ddfe1eaf3bfd942b4f4cdadea9934978b41145bffb61ac032b16b888d2e8dca1a83bc04107b', 'id': '57b53a4c-4039-4199-a61e-2021efbe7428', 'created_at': datetime.datetime(2026, 7, 3, 22, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b53a4c-4039-4199-a61e-2021efbe7428/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d223f9640>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f930c163-fe45-47a0-aeb1-247b6bf1c01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f930c163-fe45-47a0-aeb1-247b6bf1c01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114624c5-d0bd-43dd-904f-1c14b8bc1a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:36 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Volume bbaced7f-5449-4757-8209-4f341c99ac90: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bbaced7f-5449-4757-8209-4f341c99ac90', 'volume_size': 1, 'image_id': '57b53a4c-4039-4199-a61e-2021efbe7428', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b53a4c-4039-4199-a61e-2021efbe7428', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6a784ac86004cb4b8e5d9829777e385f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '461566c53a96455a8899f24de6549c64', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a809d3953da57bbe16cfa068ac06d7916bb7cab50a59ce892c71ddfe1eaf3bfd942b4f4cdadea9934978b41145bffb61ac032b16b888d2e8dca1a83bc04107b', 'id': '57b53a4c-4039-4199-a61e-2021efbe7428', 'created_at': datetime.datetime(2026, 7, 3, 22, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b53a4c-4039-4199-a61e-2021efbe7428/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d223f9640>}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Trying to clone bbaced7f-5449-4757-8209-4f341c99ac90 from image 57b53a4c-4039-4199-a61e-2021efbe7428 at location (None, [{'url': 'file:///opt/stack/data/glance/images/57b53a4c-4039-4199-a61e-2021efbe7428', 'metadata': {}}]). {{(pid=86648) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 04 00:08:36 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e" returned: 0 in 0.743s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.709s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-131736355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e860e5eb-d459-43eb-8def-13c147117b66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a75c254608fa462493f2c4912981ff7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:31Z,use_quota=True,user_id='f9890f17a3b04b23bb66790d2a2f0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Creating volume e860e5eb-d459-43eb-8def-13c147117b66 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:08:36 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e860e5eb-d459-43eb-8def-13c147117b66 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 04 00:08:36 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Image download 0.00 MB at 0.00 MB/s
Jul 04 00:08:36 devstack sudo[102944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e860e5eb-d459-43eb-8def-13c147117b66 1073741824
Jul 04 00:08:36 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a19b397-ec51-4632-8ed6-a8667b3b7798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24103140-e726-4753-822e-fa3ee5674c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:36 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e (b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e): created successfully
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24103140-e726-4753-822e-fa3ee5674c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Flow 'volume_create_manager' (2eb7e5f8-7bc6-4f97-b738-3c8cfceb3555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e10ee31-4715-47fe-a51c-e14e063d4fd7]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:36 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d4fe6475-13bf-402b-9e54-5af437bfe37e tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Created volume successfully.
Jul 04 00:08:36 devstack sudo[102946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD
Jul 04 00:08:36 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:37 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e860e5eb-d459-43eb-8def-13c147117b66 1073741824" returned: 0 in 0.862s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:37 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e860e5eb-d459-43eb-8def-13c147117b66 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:37 devstack sudo[102955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e860e5eb-d459-43eb-8def-13c147117b66
Jul 04 00:08:37 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:37 devstack sudo[102954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD
Jul 04 00:08:37 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:38 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e860e5eb-d459-43eb-8def-13c147117b66" returned: 0 in 0.647s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5b36bf-f163-4a45-b0e7-ebf6291b9b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e860e5eb-d459-43eb-8def-13c147117b66', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdef904-d577-4e54-b17d-69040f39a4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:38 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Volume volume-e860e5eb-d459-43eb-8def-13c147117b66 (e860e5eb-d459-43eb-8def-13c147117b66): created successfully
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdef904-d577-4e54-b17d-69040f39a4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Flow 'volume_create_manager' (6fb3a05f-9963-4cf2-9aa2-3e65a2c2bb92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b1ef4425-92c9-49e7-8368-2910703a0636 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Created volume successfully.
Jul 04 00:08:38 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD" returned: 1 in 0.756s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Temporary image 57b53a4c-4039-4199-a61e-2021efbe7428 is fetched for user a0077abf15134660857ef41b5ae4f086. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3af960-570d-433b-af4b-712278a84c79]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:38 devstack sudo[102962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD
Jul 04 00:08:38 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "cinder-e860e5eb-d459-43eb-8def-13c147117b66-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-e860e5eb-d459-43eb-8def-13c147117b66-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "cinder-quobyte-e860e5eb-d459-43eb-8def-13c147117b66" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-quobyte-e860e5eb-d459-43eb-8def-13c147117b66" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a7e368-5318-4509-895c-f8b046b4c79e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e860e5eb-d459-43eb-8def-13c147117b66 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:38 devstack sudo[102964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e860e5eb-d459-43eb-8def-13c147117b66
Jul 04 00:08:38 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:39 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD" returned: 0 in 0.765s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Acquiring lock "cinder-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Lock "cinder-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:39 devstack sudo[102970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD
Jul 04 00:08:39 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Acquiring lock "cinder-quobyte-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Lock "cinder-quobyte-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9502544-4bf8-4f6e-aee6-2b6ebb9d9058]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:39 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e860e5eb-d459-43eb-8def-13c147117b66" returned: 0 in 0.848s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e860e5eb-d459-43eb-8def-13c147117b66 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:39 devstack sudo[102975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75
Jul 04 00:08:39 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:39 devstack sudo[102976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e860e5eb-d459-43eb-8def-13c147117b66
Jul 04 00:08:39 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:39 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD" returned: 1 in 0.812s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbaced7f-5449-4757-8209-4f341c99ac90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='461566c53a96455a8899f24de6549c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:36Z,use_quota=True,user_id='a0077abf15134660857ef41b5ae4f086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffe3477f-9079-4fbd-aea7-cd062239ff47),volume_type_id=ffe3477f-9079-4fbd-aea7-cd062239ff47)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Creating volume bbaced7f-5449-4757-8209-4f341c99ac90 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:08:40 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:40 devstack sudo[102982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 1073741824
Jul 04 00:08:40 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:40 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e860e5eb-d459-43eb-8def-13c147117b66" returned: 0 in 0.688s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-quobyte-e860e5eb-d459-43eb-8def-13c147117b66" released by "delete_volume" :: held 1.582s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Created reservations ['e9aa2607-80e5-41b6-8304-a0502a8b9f34', '16052e8a-4804-4392-a319-f050c0a0c449', 'ae6a5ac7-2335-4073-bcf3-4783a3fc6ce3', 'ee224dd5-2385-4553-8617-267ec045e637'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:40 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" returned: 0 in 0.920s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:40 devstack sudo[102988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75
Jul 04 00:08:40 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:40 devstack sudo[102990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:40 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "cinder-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "cinder-quobyte-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-quobyte-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[209e80c0-2076-4837-8539-c815a5b8ae73]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:41 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 1073741824" returned: 0 in 1.017s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:41 devstack sudo[102998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90
Jul 04 00:08:41 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:41 devstack sudo[102996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e
Jul 04 00:08:41 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:41 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" returned: 0 in 0.842s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Lock "cinder-quobyte-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75" released by "delete_volume" :: held 1.850s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:41 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.849s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Created reservations ['95665e65-ed29-4c51-91a0-5278030e5501', 'dff5ba2b-4c86-47d0-a294-09de334578dd', '1b0965a9-e1dd-4d8a-b26a-d5180c55975b', '551729ae-69c1-4703-a7bb-53ee424ea277'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:41 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Deleted volume successfully.
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fd6c495b-d7b3-4bda-bf03-7e6dbf50a0af tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-e860e5eb-d459-43eb-8def-13c147117b66-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=132,cinder:SELECT=93,cinder:DELETE=14,cinder:INSERT=31 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:41 devstack sudo[103002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:41 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:41 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90" returned: 0 in 0.764s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:41 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e" returned: 0 in 0.877s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:41 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Attempting download of 57b53a4c-4039-4199-a61e-2021efbe7428 ((None, [{'url': 'file:///opt/stack/data/glance/images/57b53a4c-4039-4199-a61e-2021efbe7428', 'metadata': {}}])) to volume bbaced7f-5449-4757-8209-4f341c99ac90. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 04 00:08:41 devstack sudo[103008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e
Jul 04 00:08:41 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc63c80-be28-4c82-8d16-5d5c76805e3b]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b53a4c-4039-4199-a61e-2021efbe7428_hhfjw_dx {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:42 devstack sudo[103010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b53a4c-4039-4199-a61e-2021efbe7428_hhfjw_dx
Jul 04 00:08:42 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:42 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.959s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Deleted volume successfully.
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6a3125f3-6d22-4140-b4d9-c8afe230b60a tempest-TestStampPattern-908762194 None] Lock "cinder-ebb388e6-f2c9-4280-9ddb-ebd9ab281c75-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:42 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e" returned: 0 in 0.898s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-quobyte-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e" released by "delete_volume" :: held 1.827s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=108,cinder:INSERT=32,cinder:UPDATE=133,cinder:DELETE=8 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:08:42 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57b53a4c-4039-4199-a61e-2021efbe7428_hhfjw_dx" returned: 0 in 0.809s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b53a4c-4039-4199-a61e-2021efbe7428_hhfjw_dx {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Created reservations ['57ae2598-951d-43f7-a574-ac8f27faa2ea', '2faa3c8b-db5a-447f-8bf6-33829ca0a8bc', '179253c7-eb2c-420b-aa8d-42d725ed5906', '694315c5-0433-49d6-9bea-3a83ee2ea0e2'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:42 devstack sudo[103016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b53a4c-4039-4199-a61e-2021efbe7428_hhfjw_dx
Jul 04 00:08:42 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:42 devstack sudo[103017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:42 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "cinder-209a0ee8-75d6-43e7-a840-2cd2ded5f535-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-209a0ee8-75d6-43e7-a840-2cd2ded5f535-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "cinder-quobyte-209a0ee8-75d6-43e7-a840-2cd2ded5f535" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-quobyte-209a0ee8-75d6-43e7-a840-2cd2ded5f535" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[110c6e02-dc6f-4c32-bee9-6d970790f5f8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:43 devstack sudo[103020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535
Jul 04 00:08:43 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:43 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.764s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:43 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Deleted volume successfully.
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a48fcac8-277c-4493-a0b2-699a7d6b0c10 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-b6759b44-3c8b-4f1c-bcb5-f22d1bf3f77e-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:43 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b53a4c-4039-4199-a61e-2021efbe7428_hhfjw_dx" returned: 1 in 1.014s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57b53a4c-4039-4199-a61e-2021efbe7428_hhfjw_dx' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[59350a14-35dd-4cf9-a09e-b4a25e89dadf]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:43 devstack sudo[103026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD
Jul 04 00:08:43 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:44 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535" returned: 0 in 0.910s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:44 devstack sudo[103031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535
Jul 04 00:08:44 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:44 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD" returned: 0 in 0.780s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:44 devstack sudo[103035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD
Jul 04 00:08:44 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:45 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-209a0ee8-75d6-43e7-a840-2cd2ded5f535" returned: 0 in 0.765s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-quobyte-209a0ee8-75d6-43e7-a840-2cd2ded5f535" released by "delete_volume" :: held 1.729s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Created reservations ['790efa02-1d4e-4aa7-9942-d9a001d62bde', 'e54529bb-ac9c-43bf-9abd-cc461fe3985a', '07d835e9-1923-4f04-a763-586cf3e259ad', 'c454b3c2-6072-4952-b9ac-21779a6cbbfc'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:45 devstack sudo[103038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:45 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:45 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD" returned: 1 in 0.863s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] 57b53a4c-4039-4199-a61e-2021efbe7428 was raw, converting to raw {{(pid=86648) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:45 devstack sudo[103043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90
Jul 04 00:08:45 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "cinder-1839c8b1-9534-492f-8900-1bfdd98d57f7-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-1839c8b1-9534-492f-8900-1bfdd98d57f7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "cinder-quobyte-1839c8b1-9534-492f-8900-1bfdd98d57f7" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-quobyte-1839c8b1-9534-492f-8900-1bfdd98d57f7" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[be614cd2-ecae-452b-8ba0-1e05465bafd7]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1839c8b1-9534-492f-8900-1bfdd98d57f7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:45 devstack sudo[103045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1839c8b1-9534-492f-8900-1bfdd98d57f7
Jul 04 00:08:45 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:46 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.877s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:46 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:46 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Deleted volume successfully.
Jul 04 00:08:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e096b260-dc56-448b-9700-b1f94605eb68 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-209a0ee8-75d6-43e7-a840-2cd2ded5f535-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:46 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90" returned: 0 in 0.948s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:46 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57b53a4c-4039-4199-a61e-2021efbe7428_h4q9xastdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:08:46 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Converted 0.00 MB image at 0.00 MB/s
Jul 04 00:08:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:46 devstack sudo[103052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 1G
Jul 04 00:08:46 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:46 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1839c8b1-9534-492f-8900-1bfdd98d57f7" returned: 0 in 0.916s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1839c8b1-9534-492f-8900-1bfdd98d57f7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:46 devstack sudo[103058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1839c8b1-9534-492f-8900-1bfdd98d57f7
Jul 04 00:08:46 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:47 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 1G" returned: 0 in 0.843s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[64942794-9c88-4ed8-b9b3-d8fb15798cf9]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:47 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1839c8b1-9534-492f-8900-1bfdd98d57f7" returned: 0 in 0.729s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-quobyte-1839c8b1-9534-492f-8900-1bfdd98d57f7" released by "delete_volume" :: held 1.704s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Created reservations ['c4641fee-e07d-4c27-9220-418912f2454c', 'aaadabfe-182c-440a-b2ac-81a662f3e742', '1744d2a6-1023-4a16-9498-538a97dbd7d9', '97e9249b-20e1-4a7b-8653-9c8265837981'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:47 devstack sudo[103064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90
Jul 04 00:08:47 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:47 devstack sudo[103066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:47 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "cinder-66ee77e7-bbb7-48ce-a589-2b6a6effac0f-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-66ee77e7-bbb7-48ce-a589-2b6a6effac0f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "cinder-quobyte-66ee77e7-bbb7-48ce-a589-2b6a6effac0f" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-quobyte-66ee77e7-bbb7-48ce-a589-2b6a6effac0f" acquired by "delete_volume" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:48 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a70a1e8a-c33e-4d1e-85bf-225b67d94f39]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:48 devstack sudo[103068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f
Jul 04 00:08:48 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:48 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90" returned: 0 in 0.903s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:48 devstack sudo[103073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90
Jul 04 00:08:48 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:48 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.815s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:48 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Deleted volume successfully.
Jul 04 00:08:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dcb5675f-c4ce-47d9-b2aa-963ffbdf0e25 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-1839c8b1-9534-492f-8900-1bfdd98d57f7-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:48 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f" returned: 0 in 0.945s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:48 devstack sudo[103079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f
Jul 04 00:08:48 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:49 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90" returned: 1 in 0.948s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Downloaded image 57b53a4c-4039-4199-a61e-2021efbe7428 ((None, [{'url': 'file:///opt/stack/data/glance/images/57b53a4c-4039-4199-a61e-2021efbe7428', 'metadata': {}}])) to volume bbaced7f-5449-4757-8209-4f341c99ac90 successfully. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Temporary image 57b53a4c-4039-4199-a61e-2021efbe7428 for user a0077abf15134660857ef41b5ae4f086 is deleted. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Marking volume bbaced7f-5449-4757-8209-4f341c99ac90 as bootable. {{(pid=86648) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Copying metadata from image 57b53a4c-4039-4199-a61e-2021efbe7428 to bbaced7f-5449-4757-8209-4f341c99ac90. {{(pid=86648) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Creating volume glance metadata for volume bbaced7f-5449-4757-8209-4f341c99ac90 backed by image 57b53a4c-4039-4199-a61e-2021efbe7428 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '57b53a4c-4039-4199-a61e-2021efbe7428', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6a784ac86004cb4b8e5d9829777e385f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86648) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (114624c5-d0bd-43dd-904f-1c14b8bc1a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbaced7f-5449-4757-8209-4f341c99ac90', 'volume_size': 1, 'image_id': '57b53a4c-4039-4199-a61e-2021efbe7428', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57b53a4c-4039-4199-a61e-2021efbe7428', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6a784ac86004cb4b8e5d9829777e385f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '461566c53a96455a8899f24de6549c64', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0a809d3953da57bbe16cfa068ac06d7916bb7cab50a59ce892c71ddfe1eaf3bfd942b4f4cdadea9934978b41145bffb61ac032b16b888d2e8dca1a83bc04107b', 'id': '57b53a4c-4039-4199-a61e-2021efbe7428', 'created_at': datetime.datetime(2026, 7, 3, 22, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 8, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57b53a4c-4039-4199-a61e-2021efbe7428/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d223f9640>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71407f0b-9a9b-412b-9526-089ccbde074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:49 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Volume volume-bbaced7f-5449-4757-8209-4f341c99ac90 (bbaced7f-5449-4757-8209-4f341c99ac90): created successfully
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71407f0b-9a9b-412b-9526-089ccbde074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Flow 'volume_create_manager' (d1fe50cf-1e7e-4bde-b217-cc4662c28a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:49 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-725c7ddc-92eb-43d3-8057-68d21e696202 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Created volume successfully.
Jul 04 00:08:49 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-66ee77e7-bbb7-48ce-a589-2b6a6effac0f" returned: 0 in 0.742s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-quobyte-66ee77e7-bbb7-48ce-a589-2b6a6effac0f" released by "delete_volume" :: held 1.753s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Created reservations ['b8b4def4-cd92-487d-9b0f-160e15addc24', 'f3324ab6-6030-4b0d-a1b2-c10248c673e6', '1e0ff4fe-c84c-4f0c-862f-56fa3448806d', '266b2aa3-c41e-4e3a-9aba-c42fc945dd39'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:49 devstack sudo[103085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:49 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "cinder-51213f15-b36c-48a0-acde-a3f25c8ffb76-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-51213f15-b36c-48a0-acde-a3f25c8ffb76-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "cinder-quobyte-51213f15-b36c-48a0-acde-a3f25c8ffb76" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-quobyte-51213f15-b36c-48a0-acde-a3f25c8ffb76" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a8625b-e268-4416-a5c2-7ff626987d38]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-51213f15-b36c-48a0-acde-a3f25c8ffb76 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Acquiring lock "cinder-bbaced7f-5449-4757-8209-4f341c99ac90-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Lock "cinder-bbaced7f-5449-4757-8209-4f341c99ac90-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Acquiring lock "cinder-quobyte-bbaced7f-5449-4757-8209-4f341c99ac90" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Lock "cinder-quobyte-bbaced7f-5449-4757-8209-4f341c99ac90" acquired by "delete_volume" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:50 devstack sudo[103087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-51213f15-b36c-48a0-acde-a3f25c8ffb76
Jul 04 00:08:50 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71289ef-e29f-4e20-9668-b55168194dcd]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:50 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.936s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:50 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Deleted volume successfully.
Jul 04 00:08:50 devstack sudo[103090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90
Jul 04 00:08:50 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5b7b70ec-0dcc-4c27-be02-607f9b232b11 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-66ee77e7-bbb7-48ce-a589-2b6a6effac0f-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:51 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-51213f15-b36c-48a0-acde-a3f25c8ffb76" returned: 0 in 0.971s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-51213f15-b36c-48a0-acde-a3f25c8ffb76 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:51 devstack sudo[103096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-51213f15-b36c-48a0-acde-a3f25c8ffb76
Jul 04 00:08:51 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:51 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90" returned: 0 in 0.999s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:51 devstack sudo[103101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90
Jul 04 00:08:51 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:52 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-51213f15-b36c-48a0-acde-a3f25c8ffb76" returned: 0 in 0.803s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-quobyte-51213f15-b36c-48a0-acde-a3f25c8ffb76" released by "delete_volume" :: held 1.846s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:52 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Created reservations ['61db9d68-d644-4ee4-8390-ce515162edf8', '4c5983e3-9e9e-4c83-949a-814a3b1c5d1f', '12435455-d2cf-470f-8fed-9bb1381624e9', '25d0c1c6-e198-4db6-8811-7b680416cdf1'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:52 devstack sudo[103104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:52 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:52 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90" returned: 1 in 1.008s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:08:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:52 devstack sudo[103109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90
Jul 04 00:08:52 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:53 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.804s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:53 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:53 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Deleted volume successfully.
Jul 04 00:08:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4b32d769-153f-4c60-b723-f383d5a31256 tempest-CreateVolumesFromSourceVolumeTest-1816675244 None] Lock "cinder-51213f15-b36c-48a0-acde-a3f25c8ffb76-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:53 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bbaced7f-5449-4757-8209-4f341c99ac90" returned: 0 in 0.862s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Lock "cinder-quobyte-bbaced7f-5449-4757-8209-4f341c99ac90" released by "delete_volume" :: held 2.975s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:53 devstack cinder-volume[86648]: WARNING cinder.quota [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:08:53 devstack cinder-volume[86648]: WARNING cinder.quota [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:08:53 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Created reservations ['fb44a48d-840d-443e-a3d8-3c3b0cc3a1eb', 'cb82d0a7-69a5-41a8-9b0d-fdcbe67da0f2', 'ae791a8f-c503-48c0-b5eb-22907713d72a', 'bff50658-7697-4e17-b257-175b95879569'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:53 devstack sudo[103113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:08:53 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:54 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.821s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:54 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:54 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Deleted volume successfully.
Jul 04 00:08:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2b51dfb9-7730-4820-bd5f-1cdaad999b54 tempest-VolumeAndVolumeTypeFromImageTest-1068817924 None] Lock "cinder-bbaced7f-5449-4757-8209-4f341c99ac90-delete_volume" released by "delete_volume" :: held 4.102s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Flow 'volume_create_manager' (09d65e63-f6f2-48ff-9c31-caa9dea0ee72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a135e8f-e6d7-4954-9c2c-6f38308f20b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a135e8f-e6d7-4954-9c2c-6f38308f20b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1182483494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3dcb08-8c1c-4033-9064-5d7ac2e1562e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601dbb8fa37467eb42e6a7a0bfb48ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:56Z,use_quota=True,user_id='8aaac20cd90a4fc2b369eadae7ed86e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e312e1f8-081e-45f5-ab96-9c5d42339cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e312e1f8-081e-45f5-ab96-9c5d42339cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8834cc-fa6c-4ef6-a236-a04c67004266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc8834cc-fa6c-4ef6-a236-a04c67004266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb3dcb08-8c1c-4033-9064-5d7ac2e1562e', 'volume_name': 'volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0665e868-4ada-481b-804a-7e9b0154098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0665e868-4ada-481b-804a-7e9b0154098f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651781d8-9247-4d0c-ae66-b675e0128acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:55 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Volume bb3dcb08-8c1c-4033-9064-5d7ac2e1562e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e', 'volume_size': 1}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1182483494',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb3dcb08-8c1c-4033-9064-5d7ac2e1562e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601dbb8fa37467eb42e6a7a0bfb48ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:56Z,use_quota=True,user_id='8aaac20cd90a4fc2b369eadae7ed86e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Creating volume bb3dcb08-8c1c-4033-9064-5d7ac2e1562e {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:08:55 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:08:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:56 devstack sudo[103116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e 1073741824
Jul 04 00:08:56 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:56 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e 1073741824" returned: 0 in 0.928s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:56 devstack sudo[103122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e
Jul 04 00:08:56 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:57 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" returned: 0 in 0.659s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:08:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651781d8-9247-4d0c-ae66-b675e0128acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f56768-f075-49ae-a768-43f1d4737075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:57 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Volume volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e (bb3dcb08-8c1c-4033-9064-5d7ac2e1562e): created successfully
Jul 04 00:08:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f56768-f075-49ae-a768-43f1d4737075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:57 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Flow 'volume_create_manager' (09d65e63-f6f2-48ff-9c31-caa9dea0ee72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:57 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-03d0f2e4-2a18-4ecf-9783-8a41960e56b8 tempest-VolumeDependencyTests-201298987 None] Created volume successfully.
Jul 04 00:08:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] Creating offline snapshot 2b95c67e-c49e-4a1a-83b2-8e27723448e5 of volume bb3dcb08-8c1c-4033-9064-5d7ac2e1562e {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:08:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[74de750b-7ffd-417c-893b-d48284623241]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:58 devstack sudo[103125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e
Jul 04 00:08:58 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:58 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" returned: 0 in 0.754s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:58 devstack sudo[103130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5 1G
Jul 04 00:08:58 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:59 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5 1G" returned: 0 in 0.852s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:59 devstack sudo[103136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5
Jul 04 00:08:59 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:00 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5" returned: 0 in 0.720s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:00 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5 is being set with open permissions: ugo+rw
Jul 04 00:09:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:00 devstack sudo[103141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5
Jul 04 00:09:00 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:01 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5" returned: 0 in 0.651s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:01 devstack sudo[103145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.info
Jul 04 00:09:01 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:01 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.info" returned: 0 in 0.632s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:01 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.info is being set with open permissions: ugo+rw
Jul 04 00:09:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:01 devstack sudo[103148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.info
Jul 04 00:09:01 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:02 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.info" returned: 0 in 0.633s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.326s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:02 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-bd68eb39-f295-45d4-bc70-607711819a71 tempest-VolumeDependencyTests-201298987 None] Create snapshot completed successfully
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Flow 'volume_create_manager' (a9757764-52aa-410a-a700-e1bba8b712e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206033b8-ed15-4ee3-9b49-03ccfc1737c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206033b8-ed15-4ee3-9b49-03ccfc1737c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-732454088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92304472-64fd-410e-9e6a-b06b605711e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0601dbb8fa37467eb42e6a7a0bfb48ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2b95c67e-c49e-4a1a-83b2-8e27723448e5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:04Z,use_quota=True,user_id='8aaac20cd90a4fc2b369eadae7ed86e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6130107-aad0-4015-881c-4e3c96e02d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6130107-aad0-4015-881c-4e3c96e02d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c98e6eb5-5c40-44f3-a200-7e3516c7db8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c98e6eb5-5c40-44f3-a200-7e3516c7db8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '92304472-64fd-410e-9e6a-b06b605711e3', 'volume_name': 'volume-92304472-64fd-410e-9e6a-b06b605711e3', 'volume_size': 1, 'snapshot_id': '2b95c67e-c49e-4a1a-83b2-8e27723448e5'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af669fb-ba8c-4bb8-bd57-aa69cc4fcca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af669fb-ba8c-4bb8-bd57-aa69cc4fcca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9cea94-acc8-48bd-972f-380331b48a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:03 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Volume 92304472-64fd-410e-9e6a-b06b605711e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-92304472-64fd-410e-9e6a-b06b605711e3', 'volume_size': 1, 'snapshot_id': '2b95c67e-c49e-4a1a-83b2-8e27723448e5'}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Acquiring lock "cinder-quobyte-2b95c67e-c49e-4a1a-83b2-8e27723448e5-92304472-64fd-410e-9e6a-b06b605711e3" by "_create_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Lock "cinder-quobyte-2b95c67e-c49e-4a1a-83b2-8e27723448e5-92304472-64fd-410e-9e6a-b06b605711e3" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Creating volume 92304472-64fd-410e-9e6a-b06b605711e3 from snapshot 2b95c67e-c49e-4a1a-83b2-8e27723448e5 {{(pid=86648) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:09:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Acquiring lock "cinder-quobyte-92304472-64fd-410e-9e6a-b06b605711e3" by "_copy_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Lock "cinder-quobyte-92304472-64fd-410e-9e6a-b06b605711e3" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] snapshot: 2b95c67e-c49e-4a1a-83b2-8e27723448e5, volume: 92304472-64fd-410e-9e6a-b06b605711e3,  {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b06844-9cdf-42db-9c28-b18611f98616]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:04 devstack sudo[103152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5
Jul 04 00:09:04 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:04 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5" returned: 0 in 0.740s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] will copy from snapshot at /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Creating direct copy from snapshot {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35a2da3-937c-48f5-9b9d-902854abd3f4]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:04 devstack sudo[103157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e
Jul 04 00:09:04 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:05 devstack sudo[103159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:09:05 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:05 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" returned: 0 in 0.756s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG cinder.utils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Path /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3 not found in is_blk_device check {{(pid=86648) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:05 devstack sudo[103166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3
Jul 04 00:09:05 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:05 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.624s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:09:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:09:09 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3" returned: 0 in 4.230s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:09 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b580710-7443-4326-9514-63397833f3e9]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:09 devstack sudo[103180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e
Jul 04 00:09:09 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:10 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" returned: 0 in 0.887s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:10 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:09:10 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Converted 1024.00 MB image at 242.01 MB/s
Jul 04 00:09:10 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3 is being set with open permissions: ugo+rw
Jul 04 00:09:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:10 devstack sudo[103185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3
Jul 04 00:09:10 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:11 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3" returned: 0 in 0.627s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Lock "cinder-quobyte-92304472-64fd-410e-9e6a-b06b605711e3" released by "_copy_volume_from_snapshot" :: held 7.338s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Lock "cinder-quobyte-2b95c67e-c49e-4a1a-83b2-8e27723448e5-92304472-64fd-410e-9e6a-b06b605711e3" released by "_create_volume_from_snapshot" :: held 7.365s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.380s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9cea94-acc8-48bd-972f-380331b48a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92304472-64fd-410e-9e6a-b06b605711e3', 'volume_size': 1, 'snapshot_id': '2b95c67e-c49e-4a1a-83b2-8e27723448e5'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc89b2e-8aff-4709-95ed-cf8e17c8c51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:11 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Volume volume-92304472-64fd-410e-9e6a-b06b605711e3 (92304472-64fd-410e-9e6a-b06b605711e3): created successfully
Jul 04 00:09:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc89b2e-8aff-4709-95ed-cf8e17c8c51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:11 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Flow 'volume_create_manager' (a9757764-52aa-410a-a700-e1bba8b712e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:11 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9bf3296d-cdd4-4645-9405-84cc3f655162 tempest-VolumeDependencyTests-201298987 None] Created volume successfully.
Jul 04 00:09:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Acquiring lock "cinder-2b95c67e-c49e-4a1a-83b2-8e27723448e5-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Lock "cinder-2b95c67e-c49e-4a1a-83b2-8e27723448e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Acquiring lock "cinder-quobyte-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Lock "cinder-quobyte-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Acquiring lock "cinder-quobyte-2b95c67e-c49e-4a1a-83b2-8e27723448e5" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Lock "cinder-quobyte-2b95c67e-c49e-4a1a-83b2-8e27723448e5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Deleting offline snapshot 2b95c67e-c49e-4a1a-83b2-8e27723448e5 of volume bb3dcb08-8c1c-4033-9064-5d7ac2e1562e {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:09:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] snapshot_file for this snap is: volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:09:12 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3414a4-cb95-4c6a-bf8b-9738e2fcbd14]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:12 devstack sudo[103189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5
Jul 04 00:09:12 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:13 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5" returned: 0 in 0.739s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:09:13 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[449135ca-d0e6-4471-9590-07957710f3d9]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:13 devstack sudo[103194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e
Jul 04 00:09:13 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:14 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" returned: 0 in 0.706s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:14 devstack sudo[103199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5
Jul 04 00:09:14 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:14 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5" returned: 0 in 0.693s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:14 devstack sudo[103204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5
Jul 04 00:09:14 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:15 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e.2b95c67e-c49e-4a1a-83b2-8e27723448e5" returned: 0 in 0.595s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Lock "cinder-quobyte-2b95c67e-c49e-4a1a-83b2-8e27723448e5" released by "_delete_snapshot" :: held 2.829s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Lock "cinder-quobyte-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" released by "delete_snapshot" :: held 2.849s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:15 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Created reservations ['0d4a7659-070c-4817-a8bb-459f40af2369', 'cbc871f2-43ad-492e-aad5-baf4e8fec710', 'f416a1a1-c564-4c31-ade2-e59e22a021a6', '47110d74-6acd-4221-8c26-e3cbc336a33e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:15 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Delete snapshot completed successfully.
Jul 04 00:09:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4cf99258-c27f-4a21-9e75-50dacdd7a3ed tempest-VolumeDependencyTests-201298987 None] Lock "cinder-2b95c67e-c49e-4a1a-83b2-8e27723448e5-delete_snapshot" released by "delete_snapshot" :: held 2.978s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Acquiring lock "cinder-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Lock "cinder-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Acquiring lock "cinder-quobyte-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Lock "cinder-quobyte-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" acquired by "delete_volume" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:15 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db463e7-99a7-426c-8486-e1e26ebb3e84]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:15 devstack sudo[103207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e
Jul 04 00:09:15 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:16 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" returned: 0 in 0.746s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:16 devstack sudo[103248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e
Jul 04 00:09:16 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:17 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" returned: 0 in 0.598s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Lock "cinder-quobyte-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e" released by "delete_volume" :: held 1.404s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Created reservations ['44738a42-6627-4456-92fa-e9297af25556', 'c7995560-7ca7-4e6e-ba1b-66c913f16dab', '47000c2a-a50a-4c9e-b942-e5aef4df541a', 'dcfa6c96-ffe8-4028-b390-e9474d6fb9f8'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:17 devstack sudo[103251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:09:17 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:17 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.618s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:17 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Deleted volume successfully.
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-baf3eb3f-ef70-41ad-ad2d-ac1ff925b0ea tempest-VolumeDependencyTests-201298987 None] Lock "cinder-bb3dcb08-8c1c-4033-9064-5d7ac2e1562e-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Acquiring lock "cinder-92304472-64fd-410e-9e6a-b06b605711e3-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Lock "cinder-92304472-64fd-410e-9e6a-b06b605711e3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:18 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Acquiring lock "cinder-quobyte-92304472-64fd-410e-9e6a-b06b605711e3" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:18 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Lock "cinder-quobyte-92304472-64fd-410e-9e6a-b06b605711e3" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:18 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6017627c-8fa4-434a-baf3-db043d565b5f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:18 devstack sudo[103254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3
Jul 04 00:09:18 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:18 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3" returned: 0 in 0.779s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:18 devstack sudo[103259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3
Jul 04 00:09:18 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:19 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-92304472-64fd-410e-9e6a-b06b605711e3" returned: 0 in 0.704s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Lock "cinder-quobyte-92304472-64fd-410e-9e6a-b06b605711e3" released by "delete_volume" :: held 1.535s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:19 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Created reservations ['705d5fd6-89c5-4ca3-bc18-71ee4ad52380', '4e3a0aa5-689b-40e6-b1d7-428d6a996b35', '1d6ba7aa-4fd0-4fba-b40c-6c809e9d34d1', 'b06380b1-7ed0-4b78-acf2-b0907645fb8b'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:19 devstack sudo[103262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:09:19 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:20 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.732s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:20 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:20 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Deleted volume successfully.
Jul 04 00:09:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-882840a4-9e7c-4d5f-8f29-a46737fa871a tempest-VolumeDependencyTests-201298987 None] Lock "cinder-92304472-64fd-410e-9e6a-b06b605711e3-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Flow 'volume_create_manager' (9a01e6aa-07f5-4305-b3a5-9596d4461b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979e4765-45df-4ed5-b0eb-073696e5d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979e4765-45df-4ed5-b0eb-073696e5d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1745409996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b15bfb-d425-4d63-926c-acbe1c659efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f10e43cbd94a7786b270f44e154af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:24Z,use_quota=True,user_id='5a4fa37dc2c14ea5a13b9176680c2b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a9afe9-f0ec-4d27-bfc9-22665ab5ff0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a9afe9-f0ec-4d27-bfc9-22665ab5ff0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6363927-bfd2-4d0d-b3d6-4ffd6ffdb8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6363927-bfd2-4d0d-b3d6-4ffd6ffdb8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b15bfb-d425-4d63-926c-acbe1c659efc', 'volume_name': 'volume-b2b15bfb-d425-4d63-926c-acbe1c659efc', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69adef33-857c-4c17-b277-918e3af8e47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69adef33-857c-4c17-b277-918e3af8e47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7f94de-8073-42f3-a831-e5c4c451c402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:23 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Volume b2b15bfb-d425-4d63-926c-acbe1c659efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b15bfb-d425-4d63-926c-acbe1c659efc', 'volume_size': 1}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1745409996',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b15bfb-d425-4d63-926c-acbe1c659efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f10e43cbd94a7786b270f44e154af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:24Z,use_quota=True,user_id='5a4fa37dc2c14ea5a13b9176680c2b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Creating volume b2b15bfb-d425-4d63-926c-acbe1c659efc {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:09:23 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:09:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b2b15bfb-d425-4d63-926c-acbe1c659efc 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:23 devstack sudo[103267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b2b15bfb-d425-4d63-926c-acbe1c659efc 1073741824
Jul 04 00:09:23 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:24 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b2b15bfb-d425-4d63-926c-acbe1c659efc 1073741824" returned: 0 in 0.786s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b2b15bfb-d425-4d63-926c-acbe1c659efc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:24 devstack sudo[103272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b2b15bfb-d425-4d63-926c-acbe1c659efc
Jul 04 00:09:24 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:25 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b2b15bfb-d425-4d63-926c-acbe1c659efc" returned: 0 in 0.679s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:09:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7f94de-8073-42f3-a831-e5c4c451c402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b15bfb-d425-4d63-926c-acbe1c659efc', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b438ca5-a80a-45f4-93ea-0dbba8b373c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:25 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Volume volume-b2b15bfb-d425-4d63-926c-acbe1c659efc (b2b15bfb-d425-4d63-926c-acbe1c659efc): created successfully
Jul 04 00:09:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b438ca5-a80a-45f4-93ea-0dbba8b373c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Flow 'volume_create_manager' (9a01e6aa-07f5-4305-b3a5-9596d4461b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:25 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1e5f43a2-dbfb-4483-a9a4-d0ee5940f345 tempest-ProjectReaderTests-1771949789 None] Created volume successfully.
Jul 04 00:09:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Acquiring lock "cinder-b2b15bfb-d425-4d63-926c-acbe1c659efc-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Lock "cinder-b2b15bfb-d425-4d63-926c-acbe1c659efc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Acquiring lock "cinder-quobyte-b2b15bfb-d425-4d63-926c-acbe1c659efc" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Lock "cinder-quobyte-b2b15bfb-d425-4d63-926c-acbe1c659efc" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:26 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[64047716-4f2a-4142-abc2-1565d5f40140]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b2b15bfb-d425-4d63-926c-acbe1c659efc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:26 devstack sudo[103281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b2b15bfb-d425-4d63-926c-acbe1c659efc
Jul 04 00:09:26 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:26 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b2b15bfb-d425-4d63-926c-acbe1c659efc" returned: 0 in 0.756s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b2b15bfb-d425-4d63-926c-acbe1c659efc {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:27 devstack sudo[103286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b2b15bfb-d425-4d63-926c-acbe1c659efc
Jul 04 00:09:27 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:27 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-b2b15bfb-d425-4d63-926c-acbe1c659efc" returned: 0 in 0.653s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Lock "cinder-quobyte-b2b15bfb-d425-4d63-926c-acbe1c659efc" released by "delete_volume" :: held 1.449s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:27 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Created reservations ['f79dd2bb-fbb3-4f2b-a9e1-f68ba0633197', 'a0158708-7780-4349-86ab-a093ae710c56', '578c4869-a50b-4cdf-addd-dd8113810a50', 'f4ea0c20-beac-4020-97d5-25fe25de9d71'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:27 devstack sudo[103289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:09:27 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:28 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.663s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:28 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Deleted volume successfully.
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-fa2e91e5-b120-4b80-a66a-1d8ba1560c59 tempest-ProjectReaderTests-1771949789 None] Lock "cinder-b2b15bfb-d425-4d63-926c-acbe1c659efc-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Flow 'volume_create_manager' (e670261e-afdf-4eca-8c47-d89df763647b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e26fdfb-8093-4622-858b-4a78a7c04602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e26fdfb-8093-4622-858b-4a78a7c04602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81559787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d6aae2-7cd3-4a71-b606-541ab6c220c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f10e43cbd94a7786b270f44e154af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:29Z,use_quota=True,user_id='5a4fa37dc2c14ea5a13b9176680c2b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5860275f-0e99-4508-8233-8ff7c3585e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5860275f-0e99-4508-8233-8ff7c3585e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101f6ccf-d8f4-4497-be6f-eef1c8fc00e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101f6ccf-d8f4-4497-be6f-eef1c8fc00e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d6aae2-7cd3-4a71-b606-541ab6c220c3', 'volume_name': 'volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01da262b-99a5-474f-823c-528f70f5e101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01da262b-99a5-474f-823c-528f70f5e101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041c267d-d62a-4669-b53d-506415c75020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:28 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Volume 96d6aae2-7cd3-4a71-b606-541ab6c220c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3', 'volume_size': 1}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-81559787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d6aae2-7cd3-4a71-b606-541ab6c220c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26f10e43cbd94a7786b270f44e154af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:29Z,use_quota=True,user_id='5a4fa37dc2c14ea5a13b9176680c2b0a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Creating volume 96d6aae2-7cd3-4a71-b606-541ab6c220c3 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:09:28 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:09:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:28 devstack sudo[103292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3 1073741824
Jul 04 00:09:28 devstack sudo[103292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:29 devstack sudo[103292]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3 1073741824" returned: 0 in 0.785s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:29 devstack sudo[103298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3
Jul 04 00:09:29 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:30 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3" returned: 0 in 0.643s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:09:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041c267d-d62a-4669-b53d-506415c75020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cf10a3-8598-4ffb-a03b-588b5fe29d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:30 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Volume volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3 (96d6aae2-7cd3-4a71-b606-541ab6c220c3): created successfully
Jul 04 00:09:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94cf10a3-8598-4ffb-a03b-588b5fe29d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Flow 'volume_create_manager' (e670261e-afdf-4eca-8c47-d89df763647b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:30 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-65b94137-f4c5-4273-94e7-a5d8e46c247a tempest-ProjectReaderTests-1771949789 None] Created volume successfully.
Jul 04 00:09:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Acquiring lock "cinder-96d6aae2-7cd3-4a71-b606-541ab6c220c3-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Lock "cinder-96d6aae2-7cd3-4a71-b606-541ab6c220c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Acquiring lock "cinder-quobyte-96d6aae2-7cd3-4a71-b606-541ab6c220c3" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Lock "cinder-quobyte-96d6aae2-7cd3-4a71-b606-541ab6c220c3" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:31 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[319e3107-42e4-4167-95bd-542cb55b3aa2]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:31 devstack sudo[103302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3
Jul 04 00:09:31 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:31 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3" returned: 0 in 0.749s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:31 devstack sudo[103308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3
Jul 04 00:09:31 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:32 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-96d6aae2-7cd3-4a71-b606-541ab6c220c3" returned: 0 in 0.654s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Lock "cinder-quobyte-96d6aae2-7cd3-4a71-b606-541ab6c220c3" released by "delete_volume" :: held 1.439s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:32 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Created reservations ['09173d61-dca8-4da1-aa03-acddcb4cf2d0', '46d06259-11f6-4f7d-8209-f60c28eeba4c', 'ff8ee6bf-ade4-46ca-9b7d-397513ad812c', '28e0360b-d88e-462d-851a-bc639d1918a8'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:32 devstack sudo[103311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:09:32 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:33 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.640s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:33 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:33 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Deleted volume successfully.
Jul 04 00:09:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-7e5f9d9c-4810-4abf-9a2c-b0d754dc089b tempest-ProjectReaderTests-1771949789 None] Lock "cinder-96d6aae2-7cd3-4a71-b606-541ab6c220c3-delete_volume" released by "delete_volume" :: held 2.289s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Flow 'volume_create_manager' (6e39c99d-d3b4-4059-83fe-b33e9add1103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b9a55a-2c79-47e0-bf87-b4a3496ebd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b9a55a-2c79-47e0-bf87-b4a3496ebd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840721431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13430fcca0a842c389b3eb386e2c09a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:37Z,use_quota=True,user_id='82c344d8928c498c9e7f149cf2db82bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc55f49-aaa3-482a-aa87-4a303d7cf4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc55f49-aaa3-482a-aa87-4a303d7cf4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14cae966-9b74-43ea-86a2-a5e8026dd499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14cae966-9b74-43ea-86a2-a5e8026dd499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf', 'volume_name': 'volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f48727-fee7-4671-81e6-351607e163f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f48727-fee7-4671-81e6-351607e163f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e82e33-fc82-4035-9ed2-224e35f9257a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:36 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Volume 42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf', 'volume_size': 1}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840721431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13430fcca0a842c389b3eb386e2c09a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:37Z,use_quota=True,user_id='82c344d8928c498c9e7f149cf2db82bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Creating volume 42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:09:36 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:09:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:36 devstack sudo[103314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf 1073741824
Jul 04 00:09:36 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:37 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf 1073741824" returned: 0 in 0.816s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:37 devstack sudo[103319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf
Jul 04 00:09:37 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:38 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf" returned: 0 in 0.605s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e82e33-fc82-4035-9ed2-224e35f9257a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5096ab1f-5d79-4492-b49f-03b1f8b1fb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:38 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Volume volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf (42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf): created successfully
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5096ab1f-5d79-4492-b49f-03b1f8b1fb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Flow 'volume_create_manager' (6e39c99d-d3b4-4059-83fe-b33e9add1103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-61583b2c-aa15-4398-a1b5-2485d32596d5 tempest-ProjectReaderTests-123789366 None] Created volume successfully.
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Acquiring lock "cinder-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Lock "cinder-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Acquiring lock "cinder-quobyte-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Lock "cinder-quobyte-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f0bc0e-dc94-412e-8612-5e8c0a5670c8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:38 devstack sudo[103323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf
Jul 04 00:09:38 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:39 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf" returned: 0 in 0.752s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:39 devstack sudo[103328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf
Jul 04 00:09:39 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:40 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf" returned: 0 in 0.670s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Lock "cinder-quobyte-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf" released by "delete_volume" :: held 1.464s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:40 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Created reservations ['d2906570-9fbd-4a49-93ec-d15e6bfabcc9', 'c7a574c8-044a-40e9-91bd-eef471463fcc', 'f8995f27-d0a5-4939-a6bf-465539bc4353', 'e0e2c0b3-37a1-4f35-9b43-999516e5dcd9'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:40 devstack sudo[103331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:09:40 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:41 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.641s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:41 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Deleted volume successfully.
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ff45e0e-5780-4e13-92a5-65b02f965751 tempest-ProjectReaderTests-123789366 None] Lock "cinder-42c5c3ba-d2a1-48ec-aa31-06b2f9b4f0cf-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=108,cinder:DELETE=12,cinder:SELECT=86,cinder:INSERT=31 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Flow 'volume_create_manager' (e79205d0-7b98-4da5-bba9-2ba9700332d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9a2180-d58c-413e-9efa-26594466830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9a2180-d58c-413e-9efa-26594466830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1110214800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3155a9a-6de5-4c91-bbdc-d5895344f0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13430fcca0a842c389b3eb386e2c09a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:41Z,use_quota=True,user_id='82c344d8928c498c9e7f149cf2db82bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d7ae2e-9c87-4e0c-b216-968b41cff90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d7ae2e-9c87-4e0c-b216-968b41cff90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323b3f00-e36b-4d37-9a42-7a88379f56ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323b3f00-e36b-4d37-9a42-7a88379f56ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3155a9a-6de5-4c91-bbdc-d5895344f0af', 'volume_name': 'volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c068cb16-cca4-4451-b8e3-3c169614e20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c068cb16-cca4-4451-b8e3-3c169614e20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974e2d96-5248-4443-b9a7-d4f33207f9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:41 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Volume a3155a9a-6de5-4c91-bbdc-d5895344f0af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af', 'volume_size': 1}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1110214800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3155a9a-6de5-4c91-bbdc-d5895344f0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13430fcca0a842c389b3eb386e2c09a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:41Z,use_quota=True,user_id='82c344d8928c498c9e7f149cf2db82bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Creating volume a3155a9a-6de5-4c91-bbdc-d5895344f0af {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:09:41 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:09:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:41 devstack sudo[103335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af 1073741824
Jul 04 00:09:41 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:42 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af 1073741824" returned: 0 in 0.814s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:42 devstack sudo[103340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af
Jul 04 00:09:42 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:43 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af" returned: 0 in 0.627s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974e2d96-5248-4443-b9a7-d4f33207f9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a788ca11-f25d-418a-9fdf-97f6f6a8ed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=118,cinder:DELETE=7,cinder:SELECT=75,cinder:INSERT=31 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:09:43 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Volume volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af (a3155a9a-6de5-4c91-bbdc-d5895344f0af): created successfully
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a788ca11-f25d-418a-9fdf-97f6f6a8ed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Flow 'volume_create_manager' (e79205d0-7b98-4da5-bba9-2ba9700332d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:43 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4993babe-51f5-434c-adc5-7178836ec328 tempest-ProjectReaderTests-123789366 None] Created volume successfully.
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Acquiring lock "cinder-a3155a9a-6de5-4c91-bbdc-d5895344f0af-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Lock "cinder-a3155a9a-6de5-4c91-bbdc-d5895344f0af-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Acquiring lock "cinder-quobyte-a3155a9a-6de5-4c91-bbdc-d5895344f0af" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Lock "cinder-quobyte-a3155a9a-6de5-4c91-bbdc-d5895344f0af" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7027639b-30cf-4d47-8311-df39757ca9af]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:43 devstack sudo[103343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af
Jul 04 00:09:43 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:44 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af" returned: 0 in 0.757s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:44 devstack sudo[103348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af
Jul 04 00:09:44 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:45 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a3155a9a-6de5-4c91-bbdc-d5895344f0af" returned: 0 in 0.655s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Lock "cinder-quobyte-a3155a9a-6de5-4c91-bbdc-d5895344f0af" released by "delete_volume" :: held 1.447s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:45 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Created reservations ['aaf09640-6501-4309-8b18-cee6197800d0', '2f88305b-4e49-4241-8643-c39f583a8816', 'd1c49c1d-b8d8-434f-b2a4-f7c8c07ff413', 'e330b99e-ed23-41fc-93f2-a335fa63cca2'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:45 devstack sudo[103351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:09:45 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:45 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.659s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:45 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:45 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Deleted volume successfully.
Jul 04 00:09:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2c3583d2-bd1b-487e-a5ff-cf3ff1f7ac1f tempest-ProjectReaderTests-123789366 None] Lock "cinder-a3155a9a-6de5-4c91-bbdc-d5895344f0af-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Flow 'volume_create_manager' (7417c328-fb59-4ffd-8179-d302822d883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafe6eea-127b-484d-be6d-6a6e4fae2323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafe6eea-127b-484d-be6d-6a6e4fae2323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1296732488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267b2ae6-3e20-4399-8cb7-69894c973335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13430fcca0a842c389b3eb386e2c09a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:46Z,use_quota=True,user_id='82c344d8928c498c9e7f149cf2db82bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cc57d3-bc67-4a97-ada9-54aca8e75d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cc57d3-bc67-4a97-ada9-54aca8e75d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9721c3fa-a900-49ab-b309-f65c02d1043e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9721c3fa-a900-49ab-b309-f65c02d1043e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '267b2ae6-3e20-4399-8cb7-69894c973335', 'volume_name': 'volume-267b2ae6-3e20-4399-8cb7-69894c973335', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d7df34-500a-4235-852a-57cd659e7e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99d7df34-500a-4235-852a-57cd659e7e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b53568-f182-4f49-a485-8423f6a1d1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:46 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Volume 267b2ae6-3e20-4399-8cb7-69894c973335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-267b2ae6-3e20-4399-8cb7-69894c973335', 'volume_size': 1}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1296732488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267b2ae6-3e20-4399-8cb7-69894c973335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13430fcca0a842c389b3eb386e2c09a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:46Z,use_quota=True,user_id='82c344d8928c498c9e7f149cf2db82bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Creating volume 267b2ae6-3e20-4399-8cb7-69894c973335 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:09:46 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:09:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-267b2ae6-3e20-4399-8cb7-69894c973335 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:46 devstack sudo[103355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-267b2ae6-3e20-4399-8cb7-69894c973335 1073741824
Jul 04 00:09:46 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:47 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-267b2ae6-3e20-4399-8cb7-69894c973335 1073741824" returned: 0 in 0.784s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-267b2ae6-3e20-4399-8cb7-69894c973335 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:47 devstack sudo[103361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-267b2ae6-3e20-4399-8cb7-69894c973335
Jul 04 00:09:47 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:47 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-267b2ae6-3e20-4399-8cb7-69894c973335" returned: 0 in 0.620s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:09:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b53568-f182-4f49-a485-8423f6a1d1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-267b2ae6-3e20-4399-8cb7-69894c973335', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37691dce-99f0-4b63-a49d-621022ad7ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:47 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Volume volume-267b2ae6-3e20-4399-8cb7-69894c973335 (267b2ae6-3e20-4399-8cb7-69894c973335): created successfully
Jul 04 00:09:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37691dce-99f0-4b63-a49d-621022ad7ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Flow 'volume_create_manager' (7417c328-fb59-4ffd-8179-d302822d883e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:47 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e19474a2-6620-468a-8643-980652003644 tempest-ProjectReaderTests-123789366 None] Created volume successfully.
Jul 04 00:09:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Acquiring lock "cinder-267b2ae6-3e20-4399-8cb7-69894c973335-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Lock "cinder-267b2ae6-3e20-4399-8cb7-69894c973335-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Acquiring lock "cinder-quobyte-267b2ae6-3e20-4399-8cb7-69894c973335" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Lock "cinder-quobyte-267b2ae6-3e20-4399-8cb7-69894c973335" acquired by "delete_volume" :: waited 0.013s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:48 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e74d4d5-79ae-42b9-9d09-9263c7336262]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-267b2ae6-3e20-4399-8cb7-69894c973335 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:48 devstack sudo[103364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-267b2ae6-3e20-4399-8cb7-69894c973335
Jul 04 00:09:48 devstack sudo[103364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:49 devstack sudo[103364]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-267b2ae6-3e20-4399-8cb7-69894c973335" returned: 0 in 0.732s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-267b2ae6-3e20-4399-8cb7-69894c973335 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:49 devstack sudo[103369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-267b2ae6-3e20-4399-8cb7-69894c973335
Jul 04 00:09:49 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:49 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-267b2ae6-3e20-4399-8cb7-69894c973335" returned: 0 in 0.639s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Lock "cinder-quobyte-267b2ae6-3e20-4399-8cb7-69894c973335" released by "delete_volume" :: held 1.409s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:49 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Created reservations ['d47699f7-2619-45dc-8638-3ea9fd57921d', 'a3219873-3401-4bd7-88b6-724433c6bd72', 'b95cfa2b-5279-4530-8971-951c84f97a0d', '0427179c-d11b-47ca-99a6-22aefb52b781'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:50 devstack sudo[103372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:09:50 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:50 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.610s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:50 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:50 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Deleted volume successfully.
Jul 04 00:09:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e243af56-deb5-45c2-affb-b34e58ac30d9 tempest-ProjectReaderTests-123789366 None] Lock "cinder-267b2ae6-3e20-4399-8cb7-69894c973335-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Flow 'volume_create_manager' (3614e42e-08bf-4117-b266-94d67108b2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5252b8c-d7b7-4c7a-bdcd-9bbc47fcb1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5252b8c-d7b7-4c7a-bdcd-9bbc47fcb1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2139443889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06489f93-6cf1-4666-ad45-512c9edc4416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13430fcca0a842c389b3eb386e2c09a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:51Z,use_quota=True,user_id='82c344d8928c498c9e7f149cf2db82bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ba3f7d-5546-4b5a-b176-849817c7a11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ba3f7d-5546-4b5a-b176-849817c7a11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cabad8-ff94-4ade-9942-65cdc953c19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cabad8-ff94-4ade-9942-65cdc953c19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06489f93-6cf1-4666-ad45-512c9edc4416', 'volume_name': 'volume-06489f93-6cf1-4666-ad45-512c9edc4416', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf3fb12-a5d7-430c-995b-dd576b2cdae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf3fb12-a5d7-430c-995b-dd576b2cdae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1452894-c14d-4a83-aca4-8c6ca452a17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:51 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Volume 06489f93-6cf1-4666-ad45-512c9edc4416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06489f93-6cf1-4666-ad45-512c9edc4416', 'volume_size': 1}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2139443889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06489f93-6cf1-4666-ad45-512c9edc4416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13430fcca0a842c389b3eb386e2c09a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:51Z,use_quota=True,user_id='82c344d8928c498c9e7f149cf2db82bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Creating volume 06489f93-6cf1-4666-ad45-512c9edc4416 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:09:51 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-06489f93-6cf1-4666-ad45-512c9edc4416 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:51 devstack sudo[103376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-06489f93-6cf1-4666-ad45-512c9edc4416 1073741824
Jul 04 00:09:51 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:51 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-06489f93-6cf1-4666-ad45-512c9edc4416 1073741824" returned: 0 in 0.766s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-06489f93-6cf1-4666-ad45-512c9edc4416 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:51 devstack sudo[103381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-06489f93-6cf1-4666-ad45-512c9edc4416
Jul 04 00:09:51 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:52 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-06489f93-6cf1-4666-ad45-512c9edc4416" returned: 0 in 0.615s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:09:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1452894-c14d-4a83-aca4-8c6ca452a17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06489f93-6cf1-4666-ad45-512c9edc4416', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ad32df-cf41-4a7e-a4b0-fba7816179f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:52 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Volume volume-06489f93-6cf1-4666-ad45-512c9edc4416 (06489f93-6cf1-4666-ad45-512c9edc4416): created successfully
Jul 04 00:09:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ad32df-cf41-4a7e-a4b0-fba7816179f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Flow 'volume_create_manager' (3614e42e-08bf-4117-b266-94d67108b2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:52 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-aaa12d4f-1d90-4556-aae6-e86badb8a774 tempest-ProjectReaderTests-123789366 None] Created volume successfully.
Jul 04 00:09:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Acquiring lock "cinder-06489f93-6cf1-4666-ad45-512c9edc4416-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Lock "cinder-06489f93-6cf1-4666-ad45-512c9edc4416-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Acquiring lock "cinder-quobyte-06489f93-6cf1-4666-ad45-512c9edc4416" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Lock "cinder-quobyte-06489f93-6cf1-4666-ad45-512c9edc4416" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:53 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[09610d45-8cd8-47e3-870e-111a7232ce67]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-06489f93-6cf1-4666-ad45-512c9edc4416 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:53 devstack sudo[103384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-06489f93-6cf1-4666-ad45-512c9edc4416
Jul 04 00:09:53 devstack sudo[103384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:53 devstack sudo[103384]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-06489f93-6cf1-4666-ad45-512c9edc4416" returned: 0 in 0.746s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-06489f93-6cf1-4666-ad45-512c9edc4416 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:54 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-06489f93-6cf1-4666-ad45-512c9edc4416
Jul 04 00:09:54 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:54 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-06489f93-6cf1-4666-ad45-512c9edc4416" returned: 0 in 0.608s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Lock "cinder-quobyte-06489f93-6cf1-4666-ad45-512c9edc4416" released by "delete_volume" :: held 1.392s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:54 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Created reservations ['9759e6e7-2975-4e85-bc3c-3da8d7e41e11', 'e3c77464-7f9f-4370-9e31-76c27d3beb9b', '55f7d878-2cac-423a-a2f1-6a07774fbb95', 'bf018c13-af22-4a35-96f5-0a1e883d005a'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:54 devstack sudo[103392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:09:54 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:55 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.631s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:55 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:55 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Deleted volume successfully.
Jul 04 00:09:55 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5ff0a2ab-ccc3-4011-82b8-1d346c34ca57 tempest-ProjectReaderTests-123789366 None] Lock "cinder-06489f93-6cf1-4666-ad45-512c9edc4416-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:10:04 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=31,cinder:SELECT=18,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:10:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:10:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:10:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:10:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:10:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:10:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:10:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:05 devstack sudo[103397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:10:05 devstack sudo[103397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:05 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=4,cinder:SELECT=20 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:10:06 devstack sudo[103397]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.899s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:06 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:10:06 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:10:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:10:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Flow 'volume_create_manager' (f0a09208-6be3-492c-a0c3-f1b24f9cd594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fbd282-4f4b-4ddb-93a5-193a74f55f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fbd282-4f4b-4ddb-93a5-193a74f55f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2027761041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdf6658-bdac-483a-b852-2c1aaec02ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39b688b3de04793989e0a217588c7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:10:17Z,use_quota=True,user_id='ebadd843633a4ba28c7efe9d08261dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbb7b47-a61e-477f-a97e-eaef94c5f517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbb7b47-a61e-477f-a97e-eaef94c5f517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b9f364-48e3-4625-9667-b9d5860a5eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b9f364-48e3-4625-9667-b9d5860a5eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdf6658-bdac-483a-b852-2c1aaec02ee5', 'volume_name': 'volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa209f08-2ea6-4d31-bd17-f424cbfe3a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa209f08-2ea6-4d31-bd17-f424cbfe3a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8cd82a6-bb5d-49f8-9445-f9f7636be8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:10:16 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Volume bcdf6658-bdac-483a-b852-2c1aaec02ee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5', 'volume_size': 1}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2027761041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdf6658-bdac-483a-b852-2c1aaec02ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39b688b3de04793989e0a217588c7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:10:17Z,use_quota=True,user_id='ebadd843633a4ba28c7efe9d08261dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Creating volume bcdf6658-bdac-483a-b852-2c1aaec02ee5 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:10:16 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:10:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:16 devstack sudo[104054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 1073741824
Jul 04 00:10:16 devstack sudo[104054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:17 devstack sudo[104054]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 1073741824" returned: 0 in 0.812s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:17 devstack sudo[104059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5
Jul 04 00:10:17 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:18 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5" returned: 0 in 0.630s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:10:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:10:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8cd82a6-bb5d-49f8-9445-f9f7636be8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:10:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b417c2ee-80eb-4a62-aeef-abfc51b0dfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:10:18 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Volume volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 (bcdf6658-bdac-483a-b852-2c1aaec02ee5): created successfully
Jul 04 00:10:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b417c2ee-80eb-4a62-aeef-abfc51b0dfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:10:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Flow 'volume_create_manager' (f0a09208-6be3-492c-a0c3-f1b24f9cd594) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:10:18 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f376c32e-2330-459f-a3de-98a28320e146 tempest-SnapshotDependencyTests-1251757234 None] Created volume successfully.
Jul 04 00:10:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:10:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:10:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] Creating offline snapshot 8b5a9e0c-4b96-443c-939c-7724ec8773e9 of volume bcdf6658-bdac-483a-b852-2c1aaec02ee5 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:10:19 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[19128369-0e6f-416c-ae22-4c1808cf32da]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:10:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:19 devstack sudo[104062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5
Jul 04 00:10:19 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:19 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5" returned: 0 in 0.737s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:19 devstack sudo[104067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9 1G
Jul 04 00:10:19 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:20 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9 1G" returned: 0 in 0.825s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:20 devstack sudo[104072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9
Jul 04 00:10:20 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:21 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9" returned: 0 in 0.645s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:21 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9 is being set with open permissions: ugo+rw
Jul 04 00:10:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:21 devstack sudo[104079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9
Jul 04 00:10:21 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:21 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9" returned: 0 in 0.598s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:21 devstack sudo[104082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.info
Jul 04 00:10:21 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:22 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.info" returned: 0 in 0.633s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:22 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.info is being set with open permissions: ugo+rw
Jul 04 00:10:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:22 devstack sudo[104085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.info
Jul 04 00:10:22 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:23 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.info" returned: 0 in 0.606s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.126s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:10:23 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f0853630-74c0-4ee0-9265-2cfba4266213 tempest-SnapshotDependencyTests-1251757234 None] Create snapshot completed successfully
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Flow 'volume_create_manager' (79beaaef-effd-4477-9b27-f5a426e6ecf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3672a7d-d6ab-4db4-9532-9c4ff380ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3672a7d-d6ab-4db4-9532-9c4ff380ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40353d61-26cb-459d-99ed-b176e5da0424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39b688b3de04793989e0a217588c7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b5a9e0c-4b96-443c-939c-7724ec8773e9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:10:25Z,use_quota=True,user_id='ebadd843633a4ba28c7efe9d08261dcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fd62ce-2e42-4588-8bf8-ab400db5520d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fd62ce-2e42-4588-8bf8-ab400db5520d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8d6e5c-e809-4a04-8487-5d37b1785872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b8d6e5c-e809-4a04-8487-5d37b1785872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40353d61-26cb-459d-99ed-b176e5da0424', 'volume_name': 'volume-40353d61-26cb-459d-99ed-b176e5da0424', 'volume_size': 1, 'snapshot_id': '8b5a9e0c-4b96-443c-939c-7724ec8773e9'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b8232d-62a8-495f-ad9c-3d1e05b1f57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6b8232d-62a8-495f-ad9c-3d1e05b1f57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e7474a-423f-489e-a7af-10136b8f549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:10:24 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Volume 40353d61-26cb-459d-99ed-b176e5da0424: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40353d61-26cb-459d-99ed-b176e5da0424', 'volume_size': 1, 'snapshot_id': '8b5a9e0c-4b96-443c-939c-7724ec8773e9'}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "cinder-quobyte-8b5a9e0c-4b96-443c-939c-7724ec8773e9-40353d61-26cb-459d-99ed-b176e5da0424" by "_create_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-quobyte-8b5a9e0c-4b96-443c-939c-7724ec8773e9-40353d61-26cb-459d-99ed-b176e5da0424" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Creating volume 40353d61-26cb-459d-99ed-b176e5da0424 from snapshot 8b5a9e0c-4b96-443c-939c-7724ec8773e9 {{(pid=86648) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "cinder-quobyte-40353d61-26cb-459d-99ed-b176e5da0424" by "_copy_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-quobyte-40353d61-26cb-459d-99ed-b176e5da0424" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] snapshot: 8b5a9e0c-4b96-443c-939c-7724ec8773e9, volume: 40353d61-26cb-459d-99ed-b176e5da0424,  {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea8db02-8b12-44ff-b282-cdff296f8404]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:10:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:25 devstack sudo[104088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9
Jul 04 00:10:25 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:25 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9" returned: 0 in 0.724s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:10:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] will copy from snapshot at /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:10:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Creating direct copy from snapshot {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:10:25 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[56981da6-6171-4881-8b29-e051a47515fa]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:10:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:25 devstack sudo[104099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5
Jul 04 00:10:25 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:26 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5" returned: 0 in 0.764s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:26 devstack cinder-volume[86648]: DEBUG cinder.utils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Path /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424 not found in is_blk_device check {{(pid=86648) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:10:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:26 devstack sudo[104104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424
Jul 04 00:10:26 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:30 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424" returned: 0 in 4.204s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:30 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d16a21-a13c-47e3-be0e-4c7c378c9546]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:10:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:30 devstack sudo[104117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5
Jul 04 00:10:30 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:31 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5" returned: 0 in 0.911s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:31 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5, size 1024.00 MB, duration 4.21 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:10:31 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Converted 1024.00 MB image at 243.48 MB/s
Jul 04 00:10:31 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424 is being set with open permissions: ugo+rw
Jul 04 00:10:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:31 devstack sudo[104123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424
Jul 04 00:10:31 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:32 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424" returned: 0 in 0.652s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-quobyte-40353d61-26cb-459d-99ed-b176e5da0424" released by "_copy_volume_from_snapshot" :: held 7.348s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:10:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-quobyte-8b5a9e0c-4b96-443c-939c-7724ec8773e9-40353d61-26cb-459d-99ed-b176e5da0424" released by "_create_volume_from_snapshot" :: held 7.376s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:10:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.391s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:10:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e7474a-423f-489e-a7af-10136b8f549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40353d61-26cb-459d-99ed-b176e5da0424', 'volume_size': 1, 'snapshot_id': '8b5a9e0c-4b96-443c-939c-7724ec8773e9'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:10:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff43e0ea-8586-4c40-9741-cd90c4778719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:10:32 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Volume volume-40353d61-26cb-459d-99ed-b176e5da0424 (40353d61-26cb-459d-99ed-b176e5da0424): created successfully
Jul 04 00:10:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff43e0ea-8586-4c40-9741-cd90c4778719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:10:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Flow 'volume_create_manager' (79beaaef-effd-4477-9b27-f5a426e6ecf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:10:32 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-43969c87-f015-489e-8de3-af0e26dfe39d tempest-SnapshotDependencyTests-1251757234 None] Created volume successfully.
Jul 04 00:10:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "cinder-8b5a9e0c-4b96-443c-939c-7724ec8773e9-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:10:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-8b5a9e0c-4b96-443c-939c-7724ec8773e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:10:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "cinder-quobyte-bcdf6658-bdac-483a-b852-2c1aaec02ee5" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:10:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-quobyte-bcdf6658-bdac-483a-b852-2c1aaec02ee5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:10:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "cinder-quobyte-8b5a9e0c-4b96-443c-939c-7724ec8773e9" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:10:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-quobyte-8b5a9e0c-4b96-443c-939c-7724ec8773e9" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:10:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Deleting offline snapshot 8b5a9e0c-4b96-443c-939c-7724ec8773e9 of volume bcdf6658-bdac-483a-b852-2c1aaec02ee5 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:10:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] snapshot_file for this snap is: volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:10:33 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0b2d3d-da0c-4f53-bd57-8b274f1078b4]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:10:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:33 devstack sudo[104126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9
Jul 04 00:10:33 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:34 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9" returned: 0 in 0.717s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:10:34 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6125a4d5-966c-4140-b2f5-7f720ae6ec38]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:10:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:34 devstack sudo[104131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5
Jul 04 00:10:34 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:35 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5" returned: 0 in 0.709s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:35 devstack sudo[104136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9
Jul 04 00:10:35 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:35 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9" returned: 0 in 0.750s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:35 devstack sudo[104141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9
Jul 04 00:10:35 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:36 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5.8b5a9e0c-4b96-443c-939c-7724ec8773e9" returned: 0 in 0.642s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-quobyte-8b5a9e0c-4b96-443c-939c-7724ec8773e9" released by "_delete_snapshot" :: held 2.917s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:10:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-quobyte-bcdf6658-bdac-483a-b852-2c1aaec02ee5" released by "delete_snapshot" :: held 2.937s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:10:36 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Created reservations ['f2159b65-725a-4617-b45b-220df70ef4b6', '8ea68583-25f3-4854-91c0-56d64626080e', '1b764cb4-2e20-467b-9b58-9d9037c13a99', '9a0034d7-da75-4bb3-8038-0a5f6aaabe3e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:10:36 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Delete snapshot completed successfully.
Jul 04 00:10:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-85e8216c-cdf5-4bc3-b031-8e6db62ec221 tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-8b5a9e0c-4b96-443c-939c-7724ec8773e9-delete_snapshot" released by "delete_snapshot" :: held 3.076s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:10:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "cinder-bcdf6658-bdac-483a-b852-2c1aaec02ee5-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:10:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-bcdf6658-bdac-483a-b852-2c1aaec02ee5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:10:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "cinder-quobyte-bcdf6658-bdac-483a-b852-2c1aaec02ee5" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:10:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-quobyte-bcdf6658-bdac-483a-b852-2c1aaec02ee5" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:10:36 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[11438114-e7f2-4e54-9e28-b470f6e5d101]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:10:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:36 devstack sudo[104144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5
Jul 04 00:10:36 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:37 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5" returned: 0 in 0.722s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:37 devstack sudo[104149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5
Jul 04 00:10:37 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:38 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bcdf6658-bdac-483a-b852-2c1aaec02ee5" returned: 0 in 0.708s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-quobyte-bcdf6658-bdac-483a-b852-2c1aaec02ee5" released by "delete_volume" :: held 1.488s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Created reservations ['74d2c881-48d1-4c82-833a-649e997b2a89', '3e72886f-6381-4536-8fc5-e83a45125058', 'a8b7764f-2652-4006-a57d-47da99ead57c', '8109e404-1537-4ee7-8d89-922d77c5cb10'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:38 devstack sudo[104152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:10:38 devstack sudo[104152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "cinder-40353d61-26cb-459d-99ed-b176e5da0424-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-40353d61-26cb-459d-99ed-b176e5da0424-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "cinder-quobyte-40353d61-26cb-459d-99ed-b176e5da0424" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:10:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-quobyte-40353d61-26cb-459d-99ed-b176e5da0424" acquired by "delete_volume" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:10:39 devstack sudo[104152]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.647s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:39 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:10:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Deleted volume successfully.
Jul 04 00:10:39 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4416684-ff87-448e-bedd-002800d4e288]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:10:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1c52db20-6b77-45a0-a184-6a65f9cf6b9a tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-bcdf6658-bdac-483a-b852-2c1aaec02ee5-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:10:39 devstack sudo[104155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424
Jul 04 00:10:39 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:39 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424" returned: 0 in 0.817s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:39 devstack sudo[104160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424
Jul 04 00:10:39 devstack sudo[104160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:40 devstack sudo[104160]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-40353d61-26cb-459d-99ed-b176e5da0424" returned: 0 in 0.652s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-quobyte-40353d61-26cb-459d-99ed-b176e5da0424" released by "delete_volume" :: held 1.512s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:10:40 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Created reservations ['a5ec1572-2a7b-4cae-93e6-5f90164b1cb8', '02fb6bfa-0480-4d80-a6a6-f60887f3adf8', '34bda9dc-f56a-4b7e-906a-ec9571b9cd78', 'fa40a737-cc89-41b9-9750-d209679b0ecc'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:10:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:10:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:10:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:10:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:10:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:10:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:40 devstack sudo[104163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:10:40 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:41 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.635s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:41 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:10:41 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Deleted volume successfully.
Jul 04 00:10:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4b4f134b-fd57-4b6a-8093-7857e345b7e3 tempest-SnapshotDependencyTests-1251757234 None] Lock "cinder-40353d61-26cb-459d-99ed-b176e5da0424-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:10:50 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=30,cinder:SELECT=22,cinder:DELETE=2,cinder:INSERT=9 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:10:51 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=25,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:10:59 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Flow 'volume_create_manager' (679fa8f8-9df5-4d63-b0b1-0da2d41666d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b641a7a-939f-493b-950a-2d835496e6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b641a7a-939f-493b-950a-2d835496e6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-998656742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596c9093-e31f-49be-a790-602396b94ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0593506d22d94ecaa9d8518d96e851e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:00Z,use_quota=True,user_id='2904ae26d6114272b017dd744ef0b9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77fe82e-91ed-4ffb-81d6-d42097cd7a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77fe82e-91ed-4ffb-81d6-d42097cd7a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477eccf5-ded4-43c4-9458-689ac808f5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (477eccf5-ded4-43c4-9458-689ac808f5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '596c9093-e31f-49be-a790-602396b94ee3', 'volume_name': 'volume-596c9093-e31f-49be-a790-602396b94ee3', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbfab54-e782-46d2-9ba9-2319cd727fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbfab54-e782-46d2-9ba9-2319cd727fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1d56aa-c18d-4d5e-ab17-eec99457a71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume 596c9093-e31f-49be-a790-602396b94ee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-596c9093-e31f-49be-a790-602396b94ee3', 'volume_size': 1}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-998656742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596c9093-e31f-49be-a790-602396b94ee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0593506d22d94ecaa9d8518d96e851e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:00Z,use_quota=True,user_id='2904ae26d6114272b017dd744ef0b9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Creating volume 596c9093-e31f-49be-a790-602396b94ee3 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:00 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:00 devstack sudo[104211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3 1073741824
Jul 04 00:11:00 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Flow 'volume_create_manager' (e61dfe0e-cefc-4a2f-bba3-ac0cbb435017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7dc3072-7073-4d69-9453-69ddb4e6e252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7dc3072-7073-4d69-9453-69ddb4e6e252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-292927195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1620e10b-5742-4335-94d7-344bd8c47a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b56ca0ba6194956bfe064ed4b5df02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:00Z,use_quota=True,user_id='6c4eab6bc1b34332a41f65872bbe5476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69bd3d7-7bbf-4c16-880b-93b7c132d1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69bd3d7-7bbf-4c16-880b-93b7c132d1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762398c2-f0f6-43eb-a2c9-b9a67fe4789b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (762398c2-f0f6-43eb-a2c9-b9a67fe4789b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1620e10b-5742-4335-94d7-344bd8c47a8a', 'volume_name': 'volume-1620e10b-5742-4335-94d7-344bd8c47a8a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd3114a-c485-4785-8df2-5605356d1bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd3114a-c485-4785-8df2-5605356d1bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa61d7c-272d-4360-8d30-d3431b522dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume 1620e10b-5742-4335-94d7-344bd8c47a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1620e10b-5742-4335-94d7-344bd8c47a8a', 'volume_size': 1}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Flow 'volume_create_manager' (48f736a8-634a-48e2-8888-8f79a1bb9b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2063579-0da4-4b66-aad2-b87bf7ddc24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2063579-0da4-4b66-aad2-b87bf7ddc24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1429950587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d004e9f6-7263-4450-ab07-6a50f1eebf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da090b8746a41fc94954151b5c1796a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:00Z,use_quota=True,user_id='de0c47c38369458680ef99f851a16746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa94bd81-73f8-4178-bead-a08f424c1968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa94bd81-73f8-4178-bead-a08f424c1968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfadc443-aae6-4ff5-99ca-ba1dfd32912e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfadc443-aae6-4ff5-99ca-ba1dfd32912e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd004e9f6-7263-4450-ab07-6a50f1eebf9a', 'volume_name': 'volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b596eada-88d4-49e9-a21d-6a753f8f778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b596eada-88d4-49e9-a21d-6a753f8f778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ebc643-5cea-4f3f-adba-20745aeebb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Volume d004e9f6-7263-4450-ab07-6a50f1eebf9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a', 'volume_size': 1}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Flow 'volume_create_manager' (00dd6ee7-8fa6-4e8f-bc9e-4b2dd122adaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96000efa-786a-4cb2-a0a3-92575937bba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96000efa-786a-4cb2-a0a3-92575937bba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1990918062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a728f78d-d0a0-4d1f-8d06-6757929c71cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da090b8746a41fc94954151b5c1796a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:01Z,use_quota=True,user_id='de0c47c38369458680ef99f851a16746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee5f766-ade8-4643-9f93-128af40e302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ee5f766-ade8-4643-9f93-128af40e302c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a4df3c-b965-4de3-a720-de3e6f7f4d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a4df3c-b965-4de3-a720-de3e6f7f4d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a728f78d-d0a0-4d1f-8d06-6757929c71cd', 'volume_name': 'volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955273ac-d718-4898-ae69-0caa3788bf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955273ac-d718-4898-ae69-0caa3788bf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c08b766-d624-4efb-b8cb-8026bc4a5ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Volume a728f78d-d0a0-4d1f-8d06-6757929c71cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd', 'volume_size': 1}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:01 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3 1073741824" returned: 0 in 1.096s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:01 devstack sudo[104218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3
Jul 04 00:11:01 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Flow 'volume_create_manager' (f65602d2-3143-45ae-991a-a4f2e9b9e493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7be2f29-0d68-4cd7-82d8-122acec1ea8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7be2f29-0d68-4cd7-82d8-122acec1ea8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2112175612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513e6c17-f2be-474c-8e7a-0f1f2dedcefa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da090b8746a41fc94954151b5c1796a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:01Z,use_quota=True,user_id='de0c47c38369458680ef99f851a16746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb3b660-10dd-471a-a12f-851a5c756a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb3b660-10dd-471a-a12f-851a5c756a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727f073c-a0c6-4be8-8bdf-9b6177d40901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727f073c-a0c6-4be8-8bdf-9b6177d40901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513e6c17-f2be-474c-8e7a-0f1f2dedcefa', 'volume_name': 'volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138a8f6b-4c5f-48da-95c1-0762ea87cd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (138a8f6b-4c5f-48da-95c1-0762ea87cd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a53634-12c0-47d0-83fa-e688acf0afd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Volume 513e6c17-f2be-474c-8e7a-0f1f2dedcefa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa', 'volume_size': 1}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Flow 'volume_create_manager' (c63b0830-80fc-430f-90d6-af893925b3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdcb87c-5bc3-49fc-b6b9-57c3b46ba927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdcb87c-5bc3-49fc-b6b9-57c3b46ba927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-826855898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9de742-296b-435f-bc19-e7a683cdb805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da090b8746a41fc94954151b5c1796a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:02Z,use_quota=True,user_id='de0c47c38369458680ef99f851a16746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eee77c7-fefd-435d-9af5-cc6cc75cf14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eee77c7-fefd-435d-9af5-cc6cc75cf14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ee6939-36ef-4a13-b835-1299e20ab361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ee6939-36ef-4a13-b835-1299e20ab361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df9de742-296b-435f-bc19-e7a683cdb805', 'volume_name': 'volume-df9de742-296b-435f-bc19-e7a683cdb805', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d051734-7f7a-4d2f-87c0-a01e5ecbff62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d051734-7f7a-4d2f-87c0-a01e5ecbff62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7d2bc2-8bba-42ef-a5d0-e19f1fbcc337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:01 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Volume df9de742-296b-435f-bc19-e7a683cdb805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df9de742-296b-435f-bc19-e7a683cdb805', 'volume_size': 1}
Jul 04 00:11:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:02 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3" returned: 0 in 0.867s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.817s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-292927195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1620e10b-5742-4335-94d7-344bd8c47a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b56ca0ba6194956bfe064ed4b5df02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:00Z,use_quota=True,user_id='6c4eab6bc1b34332a41f65872bbe5476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Creating volume 1620e10b-5742-4335-94d7-344bd8c47a8a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:02 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1620e10b-5742-4335-94d7-344bd8c47a8a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:02 devstack sudo[104221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1620e10b-5742-4335-94d7-344bd8c47a8a 1073741824
Jul 04 00:11:02 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e1d56aa-c18d-4d5e-ab17-eec99457a71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596c9093-e31f-49be-a790-602396b94ee3', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7e7ddf-4ec1-4b6f-b96a-924bf210732d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:02 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume volume-596c9093-e31f-49be-a790-602396b94ee3 (596c9093-e31f-49be-a790-602396b94ee3): created successfully
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7e7ddf-4ec1-4b6f-b96a-924bf210732d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Flow 'volume_create_manager' (679fa8f8-9df5-4d63-b0b1-0da2d41666d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Flow 'volume_create_manager' (5ae3b2f8-6272-405a-990d-0ea92f36e76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dab8a9c-13dd-4ff0-8f75-403ffcf0acd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:02 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1c2fbcbb-a691-4d3d-92bc-29af2e83ebbc tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created volume successfully.
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dab8a9c-13dd-4ff0-8f75-403ffcf0acd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-804843968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b16f5f-c781-4163-84a9-77907d35b43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da090b8746a41fc94954151b5c1796a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:02Z,use_quota=True,user_id='de0c47c38369458680ef99f851a16746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38da7abd-abee-46ff-9704-117ab1ccbcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38da7abd-abee-46ff-9704-117ab1ccbcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f2e488-9661-4664-9681-cd295ed2c6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f2e488-9661-4664-9681-cd295ed2c6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60b16f5f-c781-4163-84a9-77907d35b43a', 'volume_name': 'volume-60b16f5f-c781-4163-84a9-77907d35b43a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba3a33c-a96b-4229-a496-71c1de6de6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba3a33c-a96b-4229-a496-71c1de6de6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74b053d-efbf-4d2d-be9d-c861ab217d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:02 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Volume 60b16f5f-c781-4163-84a9-77907d35b43a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60b16f5f-c781-4163-84a9-77907d35b43a', 'volume_size': 1}
Jul 04 00:11:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:03 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1620e10b-5742-4335-94d7-344bd8c47a8a 1073741824" returned: 0 in 0.898s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1620e10b-5742-4335-94d7-344bd8c47a8a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:03 devstack sudo[104228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1620e10b-5742-4335-94d7-344bd8c47a8a
Jul 04 00:11:03 devstack sudo[104228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:03 devstack sudo[104228]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1620e10b-5742-4335-94d7-344bd8c47a8a" returned: 0 in 0.781s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.290s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1429950587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d004e9f6-7263-4450-ab07-6a50f1eebf9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da090b8746a41fc94954151b5c1796a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:00Z,use_quota=True,user_id='de0c47c38369458680ef99f851a16746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Creating volume d004e9f6-7263-4450-ab07-6a50f1eebf9a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:03 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:03 devstack sudo[104231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a 1073741824
Jul 04 00:11:03 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa61d7c-272d-4360-8d30-d3431b522dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1620e10b-5742-4335-94d7-344bd8c47a8a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd6cd8c-46de-466f-a9a6-fe64fa341030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:03 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume volume-1620e10b-5742-4335-94d7-344bd8c47a8a (1620e10b-5742-4335-94d7-344bd8c47a8a): created successfully
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd6cd8c-46de-466f-a9a6-fe64fa341030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Flow 'volume_create_manager' (e61dfe0e-cefc-4a2f-bba3-ac0cbb435017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:03 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0ec625ac-dde9-4bfc-8ed7-49371eaf683b tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Created volume successfully.
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Flow 'volume_create_manager' (dabec24a-5fbd-4917-8219-cee979262d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ca0ba2-4fb3-4584-be95-86acbd71fc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ca0ba2-4fb3-4584-be95-86acbd71fc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b47fc2c-ae55-4f2d-a3d0-e123e83c2898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411cf2effb4749ba8429e97e0fae2509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:04Z,use_quota=True,user_id='94d25a78143d42aeba982d450cb90790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fa21cf3-6332-41a1-9171-92c6b84d55c7),volume_type_id=4fa21cf3-6332-41a1-9171-92c6b84d55c7)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e31571-10fc-44dc-a169-b32939064a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79e31571-10fc-44dc-a169-b32939064a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694d4920-31fd-46f3-be63-1cfb49b64d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.image.glance [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Creating Keystone auth plugin from conf {{(pid=86648) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694d4920-31fd-46f3-be63-1cfb49b64d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b47fc2c-ae55-4f2d-a3d0-e123e83c2898', 'volume_name': 'volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898', 'volume_size': 1, 'image_id': '08240fee-aca8-4083-acc7-627ec8881cf9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08240fee-aca8-4083-acc7-627ec8881cf9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f8cb2a7ce2ccae1a19b49f17819e6b8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '411cf2effb4749ba8429e97e0fae2509', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7eb9fd7cb2ffaa398126cc3eef4ee3fe34f1f7254d2ce130851a93e154a154f3297cc87a23f8ba9dbd6b4e8f2559627e6708bbd9dfb8184153f237ed0f1bff64', 'id': '08240fee-aca8-4083-acc7-627ec8881cf9', 'created_at': datetime.datetime(2026, 7, 3, 22, 11, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 11, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08240fee-aca8-4083-acc7-627ec8881cf9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d22402de0>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccdb805-90ec-42db-a60c-08c19950c130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ccdb805-90ec-42db-a60c-08c19950c130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c36a5c-dbce-406b-9051-9f4bf11d9c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:04 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Volume 4b47fc2c-ae55-4f2d-a3d0-e123e83c2898: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898', 'volume_size': 1, 'image_id': '08240fee-aca8-4083-acc7-627ec8881cf9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08240fee-aca8-4083-acc7-627ec8881cf9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f8cb2a7ce2ccae1a19b49f17819e6b8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '411cf2effb4749ba8429e97e0fae2509', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7eb9fd7cb2ffaa398126cc3eef4ee3fe34f1f7254d2ce130851a93e154a154f3297cc87a23f8ba9dbd6b4e8f2559627e6708bbd9dfb8184153f237ed0f1bff64', 'id': '08240fee-aca8-4083-acc7-627ec8881cf9', 'created_at': datetime.datetime(2026, 7, 3, 22, 11, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 11, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08240fee-aca8-4083-acc7-627ec8881cf9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d22402de0>}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Trying to clone 4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 from image 08240fee-aca8-4083-acc7-627ec8881cf9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08240fee-aca8-4083-acc7-627ec8881cf9', 'metadata': {}}]). {{(pid=86648) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Flow 'volume_create_manager' (b07171bb-79b3-4055-8813-22a5e724fef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4da2ae-e5f2-4e0c-9c19-11718cce8d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 04 00:11:04 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Image download 0.00 MB at 0.00 MB/s
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4da2ae-e5f2-4e0c-9c19-11718cce8d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922298058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb58357-d642-4a41-bc28-aae2db522294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b56ca0ba6194956bfe064ed4b5df02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:05Z,use_quota=True,user_id='6c4eab6bc1b34332a41f65872bbe5476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337e8eca-2e73-4822-84a9-36a5f510e003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337e8eca-2e73-4822-84a9-36a5f510e003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f64c93b-67e0-4ec1-9882-b0df93d6dec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f64c93b-67e0-4ec1-9882-b0df93d6dec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eb58357-d642-4a41-bc28-aae2db522294', 'volume_name': 'volume-8eb58357-d642-4a41-bc28-aae2db522294', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae4c00f-a534-475b-86b3-18f38918b875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae4c00f-a534-475b-86b3-18f38918b875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf0c50f-446a-4854-baf8-846168986356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:04 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume 8eb58357-d642-4a41-bc28-aae2db522294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eb58357-d642-4a41-bc28-aae2db522294', 'volume_size': 1}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:04 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a 1073741824" returned: 0 in 1.007s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3cdee9-1fbe-4f7b-8edf-bd5c408b4cac]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:04 devstack sudo[104237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a
Jul 04 00:11:04 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:05 devstack sudo[104238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD
Jul 04 00:11:05 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Flow 'volume_create_manager' (d8d95ad0-4336-408c-8f1b-4321d0c079ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9180388-3681-45bb-af19-1f2c03665a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:05 devstack sudo[104241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:05 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9180388-3681-45bb-af19-1f2c03665a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1931190917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b56ca0ba6194956bfe064ed4b5df02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:05Z,use_quota=True,user_id='6c4eab6bc1b34332a41f65872bbe5476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7004e85d-0550-4dba-b9ad-e2f92bb30bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7004e85d-0550-4dba-b9ad-e2f92bb30bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f275e4-8556-4c91-8d62-95fc7143e4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f275e4-8556-4c91-8d62-95fc7143e4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28f7f17-1ba7-41b1-ab0a-d4de44af6bb1', 'volume_name': 'volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09dfbcf8-2b10-4011-ac06-494a52fcf4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09dfbcf8-2b10-4011-ac06-494a52fcf4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a36349d-16f3-4889-a95b-fa6e0ce96867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:05 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1', 'volume_size': 1}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Flow 'volume_create_manager' (335403c7-5026-4e8a-842c-8cd918c1b1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f155c7-f531-4887-90eb-d36f30952735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f155c7-f531-4887-90eb-d36f30952735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-860741029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1686cad-0475-4cc0-af19-c7f5ec3f7a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b56ca0ba6194956bfe064ed4b5df02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:06Z,use_quota=True,user_id='6c4eab6bc1b34332a41f65872bbe5476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c145a810-ed24-47eb-9c84-9b232d082f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c145a810-ed24-47eb-9c84-9b232d082f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dadc85-63c4-4ac5-a423-45d5248f3d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dadc85-63c4-4ac5-a423-45d5248f3d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1686cad-0475-4cc0-af19-c7f5ec3f7a22', 'volume_name': 'volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbddb3b1-4f63-4c72-b728-809d567ecc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbddb3b1-4f63-4c72-b728-809d567ecc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d68b5e-b98c-4e59-ac8f-cd7052c33a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:05 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume f1686cad-0475-4cc0-af19-c7f5ec3f7a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22', 'volume_size': 1}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:05 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a" returned: 0 in 0.996s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.878s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1990918062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a728f78d-d0a0-4d1f-8d06-6757929c71cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da090b8746a41fc94954151b5c1796a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:01Z,use_quota=True,user_id='de0c47c38369458680ef99f851a16746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Creating volume a728f78d-d0a0-4d1f-8d06-6757929c71cd {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:05 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ebc643-5cea-4f3f-adba-20745aeebb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:05 devstack sudo[104249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd 1073741824
Jul 04 00:11:05 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fb7573-b7cb-4f2f-85f3-b285cc3c8177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:06 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Volume volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a (d004e9f6-7263-4450-ab07-6a50f1eebf9a): created successfully
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fb7573-b7cb-4f2f-85f3-b285cc3c8177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Flow 'volume_create_manager' (48f736a8-634a-48e2-8888-8f79a1bb9b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:06 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.869s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:06 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cb992043-5f00-4404-b31b-745d23897055 tempest-CreateVolumesFromImageTest-1027379601 None] Created volume successfully.
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Flow 'volume_create_manager' (2a12b6e5-dfef-46a1-9152-1b4fdea2f82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:06 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bbcaac-24bd-46ea-904e-1c0a4adbf7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD" returned: 0 in 1.224s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bbcaac-24bd-46ea-904e-1c0a4adbf7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1559263923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271a618d-03b8-457d-9735-7492c64e371a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b56ca0ba6194956bfe064ed4b5df02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:06Z,use_quota=True,user_id='6c4eab6bc1b34332a41f65872bbe5476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d3a105-d01b-4e38-aaee-b2406f1353d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39d3a105-d01b-4e38-aaee-b2406f1353d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13434cf-223f-483f-adb0-dcf28c8274d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b13434cf-223f-483f-adb0-dcf28c8274d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271a618d-03b8-457d-9735-7492c64e371a', 'volume_name': 'volume-271a618d-03b8-457d-9735-7492c64e371a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c2d0b4-77a5-40a3-b98e-be6c5feb95d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c2d0b4-77a5-40a3-b98e-be6c5feb95d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2767f63-39a4-4ef5-bf40-1569e54960ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:06 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume 271a618d-03b8-457d-9735-7492c64e371a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271a618d-03b8-457d-9735-7492c64e371a', 'volume_size': 1}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:06 devstack sudo[104251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD
Jul 04 00:11:06 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Flow 'volume_create_manager' (25fc415b-d4ff-464d-b62f-b2b0e1ea8732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0dad5b-279e-42da-a1fb-0599b8482caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab0dad5b-279e-42da-a1fb-0599b8482caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-910144669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ba00b7-6125-4172-929a-c39ac35f9a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b56ca0ba6194956bfe064ed4b5df02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:07Z,use_quota=True,user_id='6c4eab6bc1b34332a41f65872bbe5476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca50b27-7784-4106-b2c9-4f44f1f03da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca50b27-7784-4106-b2c9-4f44f1f03da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc90a730-aff6-40d0-9fdc-4ea4cdcd6fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc90a730-aff6-40d0-9fdc-4ea4cdcd6fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27ba00b7-6125-4172-929a-c39ac35f9a98', 'volume_name': 'volume-27ba00b7-6125-4172-929a-c39ac35f9a98', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ad2e2c-7e0b-498a-9288-d8c0d638a412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ad2e2c-7e0b-498a-9288-d8c0d638a412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e706f8-f5ae-49a1-997f-7fec98bdc0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:06 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume 27ba00b7-6125-4172-929a-c39ac35f9a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27ba00b7-6125-4172-929a-c39ac35f9a98', 'volume_size': 1}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:06 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd 1073741824" returned: 0 in 1.027s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:07 devstack sudo[104259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd
Jul 04 00:11:07 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:07 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD" returned: 1 in 0.893s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Temporary image 08240fee-aca8-4083-acc7-627ec8881cf9 is fetched for user 94d25a78143d42aeba982d450cb90790. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f732d4-f60c-4a82-9f0d-6d7f5af37b7d]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:07 devstack sudo[104261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD
Jul 04 00:11:07 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:07 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd" returned: 0 in 0.655s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.212s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2112175612',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513e6c17-f2be-474c-8e7a-0f1f2dedcefa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da090b8746a41fc94954151b5c1796a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:01Z,use_quota=True,user_id='de0c47c38369458680ef99f851a16746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Creating volume 513e6c17-f2be-474c-8e7a-0f1f2dedcefa {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:07 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:07 devstack sudo[104264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa 1073741824
Jul 04 00:11:07 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c08b766-d624-4efb-b8cb-8026bc4a5ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3074b0b1-02af-4d27-9a9e-00f1f0ebd883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:07 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Volume volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd (a728f78d-d0a0-4d1f-8d06-6757929c71cd): created successfully
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3074b0b1-02af-4d27-9a9e-00f1f0ebd883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Flow 'volume_create_manager' (00dd6ee7-8fa6-4e8f-bc9e-4b2dd122adaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:07 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b24848d0-79fb-4db2-8595-92cf6333b509 tempest-CreateVolumesFromImageTest-1027379601 None] Created volume successfully.
Jul 04 00:11:07 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD" returned: 0 in 0.721s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:07 devstack sudo[104268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD
Jul 04 00:11:07 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:08 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa 1073741824" returned: 0 in 0.795s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:08 devstack sudo[104276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa
Jul 04 00:11:08 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:08 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD" returned: 1 in 0.727s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:11:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:09 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa" returned: 0 in 0.637s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.262s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-826855898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df9de742-296b-435f-bc19-e7a683cdb805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da090b8746a41fc94954151b5c1796a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:02Z,use_quota=True,user_id='de0c47c38369458680ef99f851a16746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Creating volume df9de742-296b-435f-bc19-e7a683cdb805 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:09 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-df9de742-296b-435f-bc19-e7a683cdb805 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:09 devstack sudo[104279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-df9de742-296b-435f-bc19-e7a683cdb805 1073741824
Jul 04 00:11:09 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a53634-12c0-47d0-83fa-e688acf0afd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d60d44-d210-4bf6-945f-b38f88cb7920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:09 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Volume volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa (513e6c17-f2be-474c-8e7a-0f1f2dedcefa): created successfully
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d60d44-d210-4bf6-945f-b38f88cb7920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Flow 'volume_create_manager' (f65602d2-3143-45ae-991a-a4f2e9b9e493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f79ed5bc-03c9-42a5-9ec8-43407639bc56 tempest-CreateVolumesFromImageTest-1027379601 None] Created volume successfully.
Jul 04 00:11:09 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-df9de742-296b-435f-bc19-e7a683cdb805 1073741824" returned: 0 in 0.794s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-df9de742-296b-435f-bc19-e7a683cdb805 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:09 devstack sudo[104285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-df9de742-296b-435f-bc19-e7a683cdb805
Jul 04 00:11:09 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:10 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-df9de742-296b-435f-bc19-e7a683cdb805" returned: 0 in 0.621s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.283s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-804843968',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60b16f5f-c781-4163-84a9-77907d35b43a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da090b8746a41fc94954151b5c1796a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:02Z,use_quota=True,user_id='de0c47c38369458680ef99f851a16746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Creating volume 60b16f5f-c781-4163-84a9-77907d35b43a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:10 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60b16f5f-c781-4163-84a9-77907d35b43a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:10 devstack sudo[104288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60b16f5f-c781-4163-84a9-77907d35b43a 1073741824
Jul 04 00:11:10 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7d2bc2-8bba-42ef-a5d0-e19f1fbcc337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df9de742-296b-435f-bc19-e7a683cdb805', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7062cbb1-0c90-4fad-b9cf-ddded1c77e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:10 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Volume volume-df9de742-296b-435f-bc19-e7a683cdb805 (df9de742-296b-435f-bc19-e7a683cdb805): created successfully
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7062cbb1-0c90-4fad-b9cf-ddded1c77e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:10 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Flow 'volume_create_manager' (c63b0830-80fc-430f-90d6-af893925b3c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:10 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e417bfc0-46e6-48c4-a6ee-1e3b0ba56b3d tempest-CreateVolumesFromImageTest-1027379601 None] Created volume successfully.
Jul 04 00:11:11 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60b16f5f-c781-4163-84a9-77907d35b43a 1073741824" returned: 0 in 0.776s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60b16f5f-c781-4163-84a9-77907d35b43a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:11 devstack sudo[104294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60b16f5f-c781-4163-84a9-77907d35b43a
Jul 04 00:11:11 devstack sudo[104294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:12 devstack sudo[104294]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60b16f5f-c781-4163-84a9-77907d35b43a" returned: 0 in 0.645s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.555s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74b053d-efbf-4d2d-be9d-c861ab217d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60b16f5f-c781-4163-84a9-77907d35b43a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9c815d-1814-4157-aded-178b3ccbe2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Creating offline snapshot 4c5d5b9c-751b-4c06-ace0-85ee04e8658f of volume 596c9093-e31f-49be-a790-602396b94ee3 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:11:12 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Volume volume-60b16f5f-c781-4163-84a9-77907d35b43a (60b16f5f-c781-4163-84a9-77907d35b43a): created successfully
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca9c815d-1814-4157-aded-178b3ccbe2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Flow 'volume_create_manager' (5ae3b2f8-6272-405a-990d-0ea92f36e76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dd485f-d314-45e7-91aa-c86ddd0cb0e0]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5619b756-0596-4f71-a89a-52168a57b807 tempest-CreateVolumesFromImageTest-1027379601 None] Created volume successfully.
Jul 04 00:11:12 devstack sudo[104297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3
Jul 04 00:11:12 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:12 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3" returned: 0 in 0.740s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:12 devstack sudo[104302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f 1G
Jul 04 00:11:12 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "cinder-60b16f5f-c781-4163-84a9-77907d35b43a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-60b16f5f-c781-4163-84a9-77907d35b43a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "cinder-quobyte-60b16f5f-c781-4163-84a9-77907d35b43a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-quobyte-60b16f5f-c781-4163-84a9-77907d35b43a" acquired by "delete_volume" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:13 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[91997665-cf4c-40ff-96b5-e252e7ed2172]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60b16f5f-c781-4163-84a9-77907d35b43a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:13 devstack sudo[104304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60b16f5f-c781-4163-84a9-77907d35b43a
Jul 04 00:11:13 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:13 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f 1G" returned: 0 in 0.817s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-596c9093-e31f-49be-a790-602396b94ee3 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:13 devstack sudo[104309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-596c9093-e31f-49be-a790-602396b94ee3 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f
Jul 04 00:11:13 devstack sudo[104309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:14 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60b16f5f-c781-4163-84a9-77907d35b43a" returned: 0 in 0.808s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60b16f5f-c781-4163-84a9-77907d35b43a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:14 devstack sudo[104314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60b16f5f-c781-4163-84a9-77907d35b43a
Jul 04 00:11:14 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:14 devstack sudo[104309]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-596c9093-e31f-49be-a790-602396b94ee3 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f" returned: 0 in 0.716s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:14 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f is being set with open permissions: ugo+rw
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:14 devstack sudo[104319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f
Jul 04 00:11:14 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:14 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-60b16f5f-c781-4163-84a9-77907d35b43a" returned: 0 in 0.645s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-quobyte-60b16f5f-c781-4163-84a9-77907d35b43a" released by "delete_volume" :: held 1.496s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Created reservations ['5ca8c8a7-6d03-42c4-b928-c5fb184f935e', '4ff84562-2157-4b37-a85d-a2524cd1999e', '13bbd310-957d-4dd3-a1f4-4605d26c7a96', 'ecc20dbe-52fd-4492-9c6b-36a30a611019'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:14 devstack sudo[104322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:14 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:15 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f" returned: 0 in 0.667s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:15 devstack sudo[104325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.info
Jul 04 00:11:15 devstack sudo[104325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "cinder-df9de742-296b-435f-bc19-e7a683cdb805-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-df9de742-296b-435f-bc19-e7a683cdb805-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "cinder-quobyte-df9de742-296b-435f-bc19-e7a683cdb805" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-quobyte-df9de742-296b-435f-bc19-e7a683cdb805" acquired by "delete_volume" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[23042e58-20f5-41cd-84bc-b8690785c1bb]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-df9de742-296b-435f-bc19-e7a683cdb805 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:15 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.687s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:15 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Deleted volume successfully.
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-53e0ff94-b1fa-43ad-b006-81daccc97b96 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-60b16f5f-c781-4163-84a9-77907d35b43a-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:15 devstack sudo[104328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-df9de742-296b-435f-bc19-e7a683cdb805
Jul 04 00:11:15 devstack sudo[104328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:15 devstack sudo[104325]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.info" returned: 0 in 0.737s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:15 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.info is being set with open permissions: ugo+rw
Jul 04 00:11:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:15 devstack sudo[104331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.info
Jul 04 00:11:15 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:16 devstack sudo[104328]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-df9de742-296b-435f-bc19-e7a683cdb805" returned: 0 in 0.820s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-df9de742-296b-435f-bc19-e7a683cdb805 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:16 devstack sudo[104336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-df9de742-296b-435f-bc19-e7a683cdb805
Jul 04 00:11:16 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:16 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.info" returned: 0 in 0.690s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.484s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.692s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-922298058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eb58357-d642-4a41-bc28-aae2db522294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b56ca0ba6194956bfe064ed4b5df02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:05Z,use_quota=True,user_id='6c4eab6bc1b34332a41f65872bbe5476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Creating volume 8eb58357-d642-4a41-bc28-aae2db522294 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:16 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8eb58357-d642-4a41-bc28-aae2db522294 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:16 devstack sudo[104339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8eb58357-d642-4a41-bc28-aae2db522294 1073741824
Jul 04 00:11:16 devstack sudo[104339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:16 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4a73e614-28be-4d80-8b8f-1212ae5e4292 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Create snapshot completed successfully
Jul 04 00:11:17 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-df9de742-296b-435f-bc19-e7a683cdb805" returned: 0 in 0.696s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-quobyte-df9de742-296b-435f-bc19-e7a683cdb805" released by "delete_volume" :: held 1.567s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Created reservations ['94ddbdd0-f48f-4e45-9427-e047a2c033b1', '5b26d84f-0121-4785-8088-a072e9c54e5a', '1234f7f1-5f9a-4d5b-9cef-40e5ed9c7e53', '55053e27-d6bc-4ed8-83db-4348ed45a14c'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:17 devstack sudo[104379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:17 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:17 devstack sudo[104339]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8eb58357-d642-4a41-bc28-aae2db522294 1073741824" returned: 0 in 0.969s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8eb58357-d642-4a41-bc28-aae2db522294 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:17 devstack sudo[104385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8eb58357-d642-4a41-bc28-aae2db522294
Jul 04 00:11:17 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "cinder-513e6c17-f2be-474c-8e7a-0f1f2dedcefa-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-513e6c17-f2be-474c-8e7a-0f1f2dedcefa-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Flow 'volume_create_manager' (1fa4c406-29df-41c8-9ac6-836557d69bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846b5ddf-de91-4d43-a4cb-785158c45280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (846b5ddf-de91-4d43-a4cb-785158c45280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-816415389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fe0384-8059-4d27-822a-3bfd20335e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0593506d22d94ecaa9d8518d96e851e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:18Z,use_quota=True,user_id='2904ae26d6114272b017dd744ef0b9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc21344-58dd-4c02-b28d-a191fd6622f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc21344-58dd-4c02-b28d-a191fd6622f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10dce806-8b42-42ec-973e-f0e5e0129533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10dce806-8b42-42ec-973e-f0e5e0129533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64fe0384-8059-4d27-822a-3bfd20335e17', 'volume_name': 'volume-64fe0384-8059-4d27-822a-3bfd20335e17', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f4939c-6f54-46b4-8a58-7d3b3d28760e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f4939c-6f54-46b4-8a58-7d3b3d28760e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9492fa1-f4cf-4543-b3a2-07d4578c717a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:17 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume 64fe0384-8059-4d27-822a-3bfd20335e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64fe0384-8059-4d27-822a-3bfd20335e17', 'volume_size': 1}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "cinder-quobyte-513e6c17-f2be-474c-8e7a-0f1f2dedcefa" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-quobyte-513e6c17-f2be-474c-8e7a-0f1f2dedcefa" acquired by "delete_volume" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48a1805-a8b1-43fd-b06a-df38f563d36a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:18 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.904s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:18 devstack sudo[104387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa
Jul 04 00:11:18 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Flow 'volume_create_manager' (a9209fe4-8a0e-4b1a-a055-fe480aa078d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf13986-5aa9-485c-ba5c-09ee18124472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:18 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Deleted volume successfully.
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf13986-5aa9-485c-ba5c-09ee18124472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012943969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa68af59-4160-4f7b-a81b-cf78f43f616c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0593506d22d94ecaa9d8518d96e851e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:18Z,use_quota=True,user_id='2904ae26d6114272b017dd744ef0b9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13371405-1ca6-46ab-84fc-a9eb86297f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13371405-1ca6-46ab-84fc-a9eb86297f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277a4383-c239-433b-b2d9-0ca9f28c2208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (277a4383-c239-433b-b2d9-0ca9f28c2208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa68af59-4160-4f7b-a81b-cf78f43f616c', 'volume_name': 'volume-aa68af59-4160-4f7b-a81b-cf78f43f616c', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee5d96f-ffa9-4777-9838-ef5b7aab8dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee5d96f-ffa9-4777-9838-ef5b7aab8dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c8832c-7eb2-4022-9ce4-ce52b27b1066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:18 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume aa68af59-4160-4f7b-a81b-cf78f43f616c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa68af59-4160-4f7b-a81b-cf78f43f616c', 'volume_size': 1}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f64749c-7876-45da-a86a-5b34c68826c5 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-df9de742-296b-435f-bc19-e7a683cdb805-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:18 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8eb58357-d642-4a41-bc28-aae2db522294" returned: 0 in 0.934s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.175s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1931190917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b56ca0ba6194956bfe064ed4b5df02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:05Z,use_quota=True,user_id='6c4eab6bc1b34332a41f65872bbe5476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Creating volume d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:18 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcf0c50f-446a-4854-baf8-846168986356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eb58357-d642-4a41-bc28-aae2db522294', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0336123a-b83c-4bf7-aadd-abb462245d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:18 devstack sudo[104391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1 1073741824
Jul 04 00:11:18 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:18 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume volume-8eb58357-d642-4a41-bc28-aae2db522294 (8eb58357-d642-4a41-bc28-aae2db522294): created successfully
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0336123a-b83c-4bf7-aadd-abb462245d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Flow 'volume_create_manager' (b07171bb-79b3-4055-8813-22a5e724fef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:18 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-12d01d91-6855-4394-95b7-d4fde51b6472 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Created volume successfully.
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Flow 'volume_create_manager' (ca01793f-4cd5-455f-91dd-26107bb271b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3584f240-1531-4038-8732-1ffa1c67f249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3584f240-1531-4038-8732-1ffa1c67f249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-126498704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08b4b8a-7a02-4401-9793-9d204bb9c58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0593506d22d94ecaa9d8518d96e851e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:19Z,use_quota=True,user_id='2904ae26d6114272b017dd744ef0b9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38aaca6f-5614-4f61-be81-75423f4472c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38aaca6f-5614-4f61-be81-75423f4472c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63665f6-a353-4145-a373-9d861becc18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63665f6-a353-4145-a373-9d861becc18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a08b4b8a-7a02-4401-9793-9d204bb9c58a', 'volume_name': 'volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401b6629-f2f0-440c-b6ad-8f9c7aee0e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401b6629-f2f0-440c-b6ad-8f9c7aee0e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d837b70-a8b7-4801-91ce-c4c247847e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:18 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume a08b4b8a-7a02-4401-9793-9d204bb9c58a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a', 'volume_size': 1}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:18 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa" returned: 0 in 1.060s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:19 devstack sudo[104396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa
Jul 04 00:11:19 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Flow 'volume_create_manager' (06b75e30-b072-435c-a738-07403bfa66eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4363deb-8d0e-44da-b64f-9e2eae0d3b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4363deb-8d0e-44da-b64f-9e2eae0d3b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1981413050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1e9130-182a-40e6-bd7e-49da4002097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0593506d22d94ecaa9d8518d96e851e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:19Z,use_quota=True,user_id='2904ae26d6114272b017dd744ef0b9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc26488-81c2-4524-9587-df6202a3671a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc26488-81c2-4524-9587-df6202a3671a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce5d106-bd01-447b-83ed-43397db38e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce5d106-bd01-447b-83ed-43397db38e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d1e9130-182a-40e6-bd7e-49da4002097c', 'volume_name': 'volume-8d1e9130-182a-40e6-bd7e-49da4002097c', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f587d14-0042-4d25-88d3-210c98572dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f587d14-0042-4d25-88d3-210c98572dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da281da-c72c-4f26-b865-e229f82cada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:19 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume 8d1e9130-182a-40e6-bd7e-49da4002097c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d1e9130-182a-40e6-bd7e-49da4002097c', 'volume_size': 1}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Flow 'volume_create_manager' (7391ab34-da04-48fb-8806-c4ff10f2da41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3829c1-3987-4018-919b-ab88c34ee5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a3829c1-3987-4018-919b-ab88c34ee5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1880016766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeeaf072-34de-490f-b283-6aae343028e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0593506d22d94ecaa9d8518d96e851e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:20Z,use_quota=True,user_id='2904ae26d6114272b017dd744ef0b9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c71bc6-881f-40f2-8310-0d694072578a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c71bc6-881f-40f2-8310-0d694072578a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32598a0c-de9c-4ac6-acbd-15e0026789d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32598a0c-de9c-4ac6-acbd-15e0026789d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeeaf072-34de-490f-b283-6aae343028e4', 'volume_name': 'volume-eeeaf072-34de-490f-b283-6aae343028e4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cff7b0-5e44-4efc-8e91-2f209f2ca480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79cff7b0-5e44-4efc-8e91-2f209f2ca480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a286d6-3aff-4848-b2b3-019c2ede09f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:19 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume eeeaf072-34de-490f-b283-6aae343028e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeeaf072-34de-490f-b283-6aae343028e4', 'volume_size': 1}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:19 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1 1073741824" returned: 0 in 1.199s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:19 devstack sudo[104402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1
Jul 04 00:11:19 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:19 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-513e6c17-f2be-474c-8e7a-0f1f2dedcefa" returned: 0 in 0.892s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-quobyte-513e6c17-f2be-474c-8e7a-0f1f2dedcefa" released by "delete_volume" :: held 1.999s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:19 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Created reservations ['4830e1c3-3140-4d3e-89fb-2f6eda3ded04', '3df5c94c-4941-4cf2-93d0-a2753b7a350e', '901a1b40-9dc7-4399-b816-477cc09062c3', 'f34d8ca3-0470-44c2-b119-4cdeb4b07545'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:20 devstack sudo[104404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:20 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:20 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1" returned: 0 in 0.684s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.645s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-860741029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1686cad-0475-4cc0-af19-c7f5ec3f7a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b56ca0ba6194956bfe064ed4b5df02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:06Z,use_quota=True,user_id='6c4eab6bc1b34332a41f65872bbe5476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Creating volume f1686cad-0475-4cc0-af19-c7f5ec3f7a22 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:20 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a36349d-16f3-4889-a95b-fa6e0ce96867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:20 devstack sudo[104407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22 1073741824
Jul 04 00:11:20 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5973d1-2b92-44e4-b56e-b066e1ad064d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:20 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1 (d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1): created successfully
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5973d1-2b92-44e4-b56e-b066e1ad064d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Flow 'volume_create_manager' (d8d95ad0-4336-408c-8f1b-4321d0c079ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:20 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ebdf114e-b4e8-471b-90b4-1928c2399cd3 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Created volume successfully.
Jul 04 00:11:20 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.660s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:20 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Deleted volume successfully.
Jul 04 00:11:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1727c8da-8558-45aa-9dbb-00bf746ea6f3 tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-513e6c17-f2be-474c-8e7a-0f1f2dedcefa-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "cinder-a728f78d-d0a0-4d1f-8d06-6757929c71cd-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-a728f78d-d0a0-4d1f-8d06-6757929c71cd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "cinder-quobyte-a728f78d-d0a0-4d1f-8d06-6757929c71cd" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:21 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-quobyte-a728f78d-d0a0-4d1f-8d06-6757929c71cd" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:21 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69b05d9-b0a1-4476-8792-ef7dd9ca4403]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:21 devstack sudo[104414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd
Jul 04 00:11:21 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:21 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22 1073741824" returned: 0 in 0.884s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:21 devstack sudo[104416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22
Jul 04 00:11:21 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:21 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd" returned: 0 in 0.786s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:21 devstack sudo[104421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd
Jul 04 00:11:21 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:22 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22" returned: 0 in 0.670s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.844s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1559263923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271a618d-03b8-457d-9735-7492c64e371a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b56ca0ba6194956bfe064ed4b5df02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:06Z,use_quota=True,user_id='6c4eab6bc1b34332a41f65872bbe5476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Creating volume 271a618d-03b8-457d-9735-7492c64e371a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:22 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-271a618d-03b8-457d-9735-7492c64e371a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:22 devstack sudo[104424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-271a618d-03b8-457d-9735-7492c64e371a 1073741824
Jul 04 00:11:22 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d68b5e-b98c-4e59-ac8f-cd7052c33a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f93869a-8e40-4179-b438-35b47dc31bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:22 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22 (f1686cad-0475-4cc0-af19-c7f5ec3f7a22): created successfully
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f93869a-8e40-4179-b438-35b47dc31bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Flow 'volume_create_manager' (335403c7-5026-4e8a-842c-8cd918c1b1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:22 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-7fa4035c-d420-463a-8d25-4aed6703e2c0 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Created volume successfully.
Jul 04 00:11:22 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a728f78d-d0a0-4d1f-8d06-6757929c71cd" returned: 0 in 0.667s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-quobyte-a728f78d-d0a0-4d1f-8d06-6757929c71cd" released by "delete_volume" :: held 1.491s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Created reservations ['dc729c0b-08ce-4dc1-8eb7-f5c2dc4b423c', '08b51d1b-0251-4f9d-8c95-3004609a6536', 'e1df8917-4fb7-421e-a7c7-474196e5b19b', '746c530e-4060-4bfd-885e-dd5f9559f557'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:22 devstack sudo[104430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:22 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:22 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-271a618d-03b8-457d-9735-7492c64e371a 1073741824" returned: 0 in 0.874s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-271a618d-03b8-457d-9735-7492c64e371a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:23 devstack sudo[104432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-271a618d-03b8-457d-9735-7492c64e371a
Jul 04 00:11:23 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "cinder-d004e9f6-7263-4450-ab07-6a50f1eebf9a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-d004e9f6-7263-4450-ab07-6a50f1eebf9a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "cinder-quobyte-d004e9f6-7263-4450-ab07-6a50f1eebf9a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-quobyte-d004e9f6-7263-4450-ab07-6a50f1eebf9a" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[62402d18-e3a7-4fb3-92a3-1522f275cae0]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:23 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.706s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:23 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Deleted volume successfully.
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d79bf530-df31-406c-a56d-2eb5bb99531d tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-a728f78d-d0a0-4d1f-8d06-6757929c71cd-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:23 devstack sudo[104435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a
Jul 04 00:11:23 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:23 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-271a618d-03b8-457d-9735-7492c64e371a" returned: 0 in 0.670s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.953s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-910144669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27ba00b7-6125-4172-929a-c39ac35f9a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b56ca0ba6194956bfe064ed4b5df02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:07Z,use_quota=True,user_id='6c4eab6bc1b34332a41f65872bbe5476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Creating volume 27ba00b7-6125-4172-929a-c39ac35f9a98 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:23 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-27ba00b7-6125-4172-929a-c39ac35f9a98 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:23 devstack sudo[104438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-27ba00b7-6125-4172-929a-c39ac35f9a98 1073741824
Jul 04 00:11:23 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2767f63-39a4-4ef5-bf40-1569e54960ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271a618d-03b8-457d-9735-7492c64e371a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f409e886-b2a4-4ab7-a313-ac89ddeca3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:23 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume volume-271a618d-03b8-457d-9735-7492c64e371a (271a618d-03b8-457d-9735-7492c64e371a): created successfully
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f409e886-b2a4-4ab7-a313-ac89ddeca3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:23 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Flow 'volume_create_manager' (2a12b6e5-dfef-46a1-9152-1b4fdea2f82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:23 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-50f503fa-ee68-4dac-8685-1e5a6ebfb4b8 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Created volume successfully.
Jul 04 00:11:24 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a" returned: 0 in 0.765s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:24 devstack sudo[104443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a
Jul 04 00:11:24 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:24 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-27ba00b7-6125-4172-929a-c39ac35f9a98 1073741824" returned: 0 in 0.860s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-27ba00b7-6125-4172-929a-c39ac35f9a98 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:24 devstack sudo[104448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-27ba00b7-6125-4172-929a-c39ac35f9a98
Jul 04 00:11:24 devstack sudo[104448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:24 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d004e9f6-7263-4450-ab07-6a50f1eebf9a" returned: 0 in 0.660s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-quobyte-d004e9f6-7263-4450-ab07-6a50f1eebf9a" released by "delete_volume" :: held 1.486s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Created reservations ['bbe6c923-bcce-40e3-81f9-aff97d8bb489', '1c72db83-9d48-4fe5-ab1b-3c7ad89b5a34', '77251b7a-19a6-42b1-a73a-29f186f8624b', 'be86c0c4-9057-4808-b6ec-2456b076a701'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:25 devstack sudo[104451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:25 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:25 devstack sudo[104448]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-27ba00b7-6125-4172-929a-c39ac35f9a98" returned: 0 in 0.676s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.692s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b47fc2c-ae55-4f2d-a3d0-e123e83c2898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411cf2effb4749ba8429e97e0fae2509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:04Z,use_quota=True,user_id='94d25a78143d42aeba982d450cb90790',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4fa21cf3-6332-41a1-9171-92c6b84d55c7),volume_type_id=4fa21cf3-6332-41a1-9171-92c6b84d55c7)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Creating volume 4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:25 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03e706f8-f5ae-49a1-997f-7fec98bdc0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27ba00b7-6125-4172-929a-c39ac35f9a98', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43405a2-dd8d-4149-8885-19ce6f6154fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:25 devstack sudo[104454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 1073741824
Jul 04 00:11:25 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:25 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Volume volume-27ba00b7-6125-4172-929a-c39ac35f9a98 (27ba00b7-6125-4172-929a-c39ac35f9a98): created successfully
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43405a2-dd8d-4149-8885-19ce6f6154fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Flow 'volume_create_manager' (25fc415b-d4ff-464d-b62f-b2b0e1ea8732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:25 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a0289a3c-23b0-452b-8caa-9a4c19650788 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Created volume successfully.
Jul 04 00:11:25 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.671s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:25 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Deleted volume successfully.
Jul 04 00:11:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-94391d29-7caa-4002-b639-abb00174265c tempest-CreateVolumesFromImageTest-1027379601 None] Lock "cinder-d004e9f6-7263-4450-ab07-6a50f1eebf9a-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "cinder-27ba00b7-6125-4172-929a-c39ac35f9a98-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-27ba00b7-6125-4172-929a-c39ac35f9a98-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "cinder-quobyte-27ba00b7-6125-4172-929a-c39ac35f9a98" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-quobyte-27ba00b7-6125-4172-929a-c39ac35f9a98" acquired by "delete_volume" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:26 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 1073741824" returned: 0 in 1.006s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:26 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4729697-c0d2-4dba-a17d-52d757014a9f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-27ba00b7-6125-4172-929a-c39ac35f9a98 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:26 devstack sudo[104468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898
Jul 04 00:11:26 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:26 devstack sudo[104467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-27ba00b7-6125-4172-929a-c39ac35f9a98
Jul 04 00:11:26 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:27 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898" returned: 0 in 0.724s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.825s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.236s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-816415389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64fe0384-8059-4d27-822a-3bfd20335e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0593506d22d94ecaa9d8518d96e851e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:18Z,use_quota=True,user_id='2904ae26d6114272b017dd744ef0b9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Creating volume 64fe0384-8059-4d27-822a-3bfd20335e17 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:27 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-64fe0384-8059-4d27-822a-3bfd20335e17 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Attempting download of 08240fee-aca8-4083-acc7-627ec8881cf9 ((None, [{'url': 'file:///opt/stack/data/glance/images/08240fee-aca8-4083-acc7-627ec8881cf9', 'metadata': {}}])) to volume 4b47fc2c-ae55-4f2d-a3d0-e123e83c2898. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 04 00:11:27 devstack sudo[104475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-64fe0384-8059-4d27-822a-3bfd20335e17 1073741824
Jul 04 00:11:27 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:27 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-27ba00b7-6125-4172-929a-c39ac35f9a98" returned: 0 in 0.934s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-27ba00b7-6125-4172-929a-c39ac35f9a98 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[299414dc-9d28-4ccd-acd4-c02ae29836a8]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08240fee-aca8-4083-acc7-627ec8881cf9_f1tizag4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:27 devstack sudo[104477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-27ba00b7-6125-4172-929a-c39ac35f9a98
Jul 04 00:11:27 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:27 devstack sudo[104478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08240fee-aca8-4083-acc7-627ec8881cf9_f1tizag4
Jul 04 00:11:27 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:28 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-27ba00b7-6125-4172-929a-c39ac35f9a98" returned: 0 in 0.864s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-quobyte-27ba00b7-6125-4172-929a-c39ac35f9a98" released by "delete_volume" :: held 1.862s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Created reservations ['79be6047-9ba9-462d-aa1a-e11121d7c010', '27aa5d53-0a81-48bd-a3f2-e037e8e07ef8', 'fa0c4235-a4c1-4c79-bbb7-7a5fb04e8d19', '2cf1dc19-5f84-4c8d-8461-32316ca6735b'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:28 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:28 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08240fee-aca8-4083-acc7-627ec8881cf9_f1tizag4" returned: 0 in 0.922s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08240fee-aca8-4083-acc7-627ec8881cf9_f1tizag4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-64fe0384-8059-4d27-822a-3bfd20335e17 1073741824" returned: 0 in 1.099s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-64fe0384-8059-4d27-822a-3bfd20335e17 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:28 devstack sudo[104491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-64fe0384-8059-4d27-822a-3bfd20335e17
Jul 04 00:11:28 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:28 devstack sudo[104490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08240fee-aca8-4083-acc7-627ec8881cf9_f1tizag4
Jul 04 00:11:28 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:28 devstack sudo[104494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:28 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "cinder-271a618d-03b8-457d-9735-7492c64e371a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-271a618d-03b8-457d-9735-7492c64e371a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "cinder-quobyte-271a618d-03b8-457d-9735-7492c64e371a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-quobyte-271a618d-03b8-457d-9735-7492c64e371a" acquired by "delete_volume" :: waited 0.031s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[248701d5-dec6-4e0a-afd8-5ac3c2aef03d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-271a618d-03b8-457d-9735-7492c64e371a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:28 devstack sudo[104496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-271a618d-03b8-457d-9735-7492c64e371a
Jul 04 00:11:28 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:29 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-64fe0384-8059-4d27-822a-3bfd20335e17" returned: 0 in 0.856s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.829s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1012943969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa68af59-4160-4f7b-a81b-cf78f43f616c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0593506d22d94ecaa9d8518d96e851e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:18Z,use_quota=True,user_id='2904ae26d6114272b017dd744ef0b9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Creating volume aa68af59-4160-4f7b-a81b-cf78f43f616c {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:29 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-aa68af59-4160-4f7b-a81b-cf78f43f616c 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:29 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08240fee-aca8-4083-acc7-627ec8881cf9_f1tizag4" returned: 1 in 1.026s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08240fee-aca8-4083-acc7-627ec8881cf9_f1tizag4' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[96cdd3f2-c70a-4072-9ccd-d519ee03a6f5]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9492fa1-f4cf-4543-b3a2-07d4578c717a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64fe0384-8059-4d27-822a-3bfd20335e17', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:29 devstack sudo[104502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-aa68af59-4160-4f7b-a81b-cf78f43f616c 1073741824
Jul 04 00:11:29 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06986cbc-f96b-42cf-954d-6f62146de6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:29 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume volume-64fe0384-8059-4d27-822a-3bfd20335e17 (64fe0384-8059-4d27-822a-3bfd20335e17): created successfully
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06986cbc-f96b-42cf-954d-6f62146de6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:29 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Flow 'volume_create_manager' (1fa4c406-29df-41c8-9ac6-836557d69bc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.998s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:29 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Deleted volume successfully.
Jul 04 00:11:29 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-88234ac3-e630-4218-843d-9d6621a94732 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created volume successfully.
Jul 04 00:11:29 devstack sudo[104503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD
Jul 04 00:11:29 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-79a6818a-bf66-4f09-b834-329d8777662e tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-27ba00b7-6125-4172-929a-c39ac35f9a98-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:29 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-271a618d-03b8-457d-9735-7492c64e371a" returned: 0 in 0.950s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-271a618d-03b8-457d-9735-7492c64e371a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:29 devstack sudo[104510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-271a618d-03b8-457d-9735-7492c64e371a
Jul 04 00:11:29 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:30 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD" returned: 0 in 0.930s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:30 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-aa68af59-4160-4f7b-a81b-cf78f43f616c 1073741824" returned: 0 in 1.084s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:30 devstack sudo[104519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-aa68af59-4160-4f7b-a81b-cf78f43f616c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:30 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:30 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-271a618d-03b8-457d-9735-7492c64e371a" returned: 0 in 0.739s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-quobyte-271a618d-03b8-457d-9735-7492c64e371a" released by "delete_volume" :: held 1.750s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:30 devstack sudo[104521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-aa68af59-4160-4f7b-a81b-cf78f43f616c
Jul 04 00:11:30 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Created reservations ['2a19ccb7-aaa6-4865-b40b-6d887a2d4b8a', '10107e58-d800-4385-bd5c-e94d8a47892e', '275419a3-a40d-4825-b46c-038dc2298c55', '23602322-7422-4f69-be01-d25f88216306'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:30 devstack sudo[104523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:30 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "cinder-f1686cad-0475-4cc0-af19-c7f5ec3f7a22-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-f1686cad-0475-4cc0-af19-c7f5ec3f7a22-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:30 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "cinder-quobyte-f1686cad-0475-4cc0-af19-c7f5ec3f7a22" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-quobyte-f1686cad-0475-4cc0-af19-c7f5ec3f7a22" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:31 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD" returned: 1 in 0.891s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] 08240fee-aca8-4083-acc7-627ec8881cf9 was raw, converting to raw {{(pid=86648) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bade0679-161e-4f35-8029-c78a02847f21]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:31 devstack sudo[104530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898
Jul 04 00:11:31 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:31 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-aa68af59-4160-4f7b-a81b-cf78f43f616c" returned: 0 in 0.816s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.268s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-126498704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08b4b8a-7a02-4401-9793-9d204bb9c58a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0593506d22d94ecaa9d8518d96e851e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:19Z,use_quota=True,user_id='2904ae26d6114272b017dd744ef0b9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Creating volume a08b4b8a-7a02-4401-9793-9d204bb9c58a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:31 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:31 devstack sudo[104534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a 1073741824
Jul 04 00:11:31 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c8832c-7eb2-4022-9ce4-ce52b27b1066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa68af59-4160-4f7b-a81b-cf78f43f616c', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fd3661-2abe-4537-b251-897448bf8b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:31 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume volume-aa68af59-4160-4f7b-a81b-cf78f43f616c (aa68af59-4160-4f7b-a81b-cf78f43f616c): created successfully
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19fd3661-2abe-4537-b251-897448bf8b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Flow 'volume_create_manager' (a9209fe4-8a0e-4b1a-a055-fe480aa078d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:31 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-88076c5a-de7f-4288-b87f-2f8c6b0e3f29 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created volume successfully.
Jul 04 00:11:31 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:31 devstack sudo[104531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22
Jul 04 00:11:31 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.876s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:31 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Deleted volume successfully.
Jul 04 00:11:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-221a4fff-1c0e-448b-8b32-e26447ec0436 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-271a618d-03b8-457d-9735-7492c64e371a-delete_volume" released by "delete_volume" :: held 2.880s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:32 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898" returned: 0 in 1.045s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08240fee-aca8-4083-acc7-627ec8881cf9_qv4szv17devstack@QuobyteHD, size 0.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:11:32 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Converted 0.00 MB image at 0.00 MB/s
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:32 devstack sudo[104547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 1G
Jul 04 00:11:32 devstack sudo[104547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:32 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22" returned: 0 in 1.123s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:32 devstack sudo[104549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22
Jul 04 00:11:32 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:32 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a 1073741824" returned: 0 in 1.121s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:32 devstack sudo[104551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a
Jul 04 00:11:32 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:32 devstack sudo[104547]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 1G" returned: 0 in 0.720s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d29173e-54f0-408f-8be5-07479048e450]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:32 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1686cad-0475-4cc0-af19-c7f5ec3f7a22" returned: 0 in 0.747s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:32 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a" returned: 0 in 0.675s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-quobyte-f1686cad-0475-4cc0-af19-c7f5ec3f7a22" released by "delete_volume" :: held 1.967s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.571s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1981413050',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d1e9130-182a-40e6-bd7e-49da4002097c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0593506d22d94ecaa9d8518d96e851e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:19Z,use_quota=True,user_id='2904ae26d6114272b017dd744ef0b9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Creating volume 8d1e9130-182a-40e6-bd7e-49da4002097c {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:32 devstack sudo[104558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:32 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:32 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8d1e9130-182a-40e6-bd7e-49da4002097c 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:33 devstack sudo[104560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8d1e9130-182a-40e6-bd7e-49da4002097c 1073741824
Jul 04 00:11:33 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d837b70-a8b7-4801-91ce-c4c247847e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd3ed82-7d17-479c-bf19-9b028e2a5e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:33 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a (a08b4b8a-7a02-4401-9793-9d204bb9c58a): created successfully
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fd3ed82-7d17-479c-bf19-9b028e2a5e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Flow 'volume_create_manager' (ca01793f-4cd5-455f-91dd-26107bb271b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:33 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-47a9414b-bd1d-4111-9af7-ce2db3097a12 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created volume successfully.
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Created reservations ['989c93ed-b11b-4c0a-a404-2ea9327573bf', '5f274503-c3cc-4c38-9836-c898b7eb0927', 'e9e419f9-d179-437c-9ee4-defc2ee585ba', '30f74aa4-56e5-46e4-9d6b-d07b9b2f489c'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:33 devstack sudo[104562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:33 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:33 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898" returned: 0 in 0.987s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:33 devstack sudo[104569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898
Jul 04 00:11:33 devstack sudo[104569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:34 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8d1e9130-182a-40e6-bd7e-49da4002097c 1073741824" returned: 0 in 1.168s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:34 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.926s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Deleted volume successfully.
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8d1e9130-182a-40e6-bd7e-49da4002097c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:34 devstack sudo[104573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8d1e9130-182a-40e6-bd7e-49da4002097c
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6da2e118-bbb3-47d3-afa0-75909e47521a tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-f1686cad-0475-4cc0-af19-c7f5ec3f7a22-delete_volume" released by "delete_volume" :: held 3.405s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:34 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "cinder-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "cinder-quobyte-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-quobyte-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1a46a6-f9fa-42a1-b2da-ac39067c9826]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:34 devstack sudo[104575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1
Jul 04 00:11:34 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:34 devstack sudo[104569]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898" returned: 1 in 0.937s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Downloaded image 08240fee-aca8-4083-acc7-627ec8881cf9 ((None, [{'url': 'file:///opt/stack/data/glance/images/08240fee-aca8-4083-acc7-627ec8881cf9', 'metadata': {}}])) to volume 4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 successfully. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Temporary image 08240fee-aca8-4083-acc7-627ec8881cf9 for user 94d25a78143d42aeba982d450cb90790 is deleted. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Marking volume 4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 as bootable. {{(pid=86648) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Copying metadata from image 08240fee-aca8-4083-acc7-627ec8881cf9 to 4b47fc2c-ae55-4f2d-a3d0-e123e83c2898. {{(pid=86648) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Creating volume glance metadata for volume 4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 backed by image 08240fee-aca8-4083-acc7-627ec8881cf9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '08240fee-aca8-4083-acc7-627ec8881cf9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4f8cb2a7ce2ccae1a19b49f17819e6b8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86648) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c36a5c-dbce-406b-9051-9f4bf11d9c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898', 'volume_size': 1, 'image_id': '08240fee-aca8-4083-acc7-627ec8881cf9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08240fee-aca8-4083-acc7-627ec8881cf9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4f8cb2a7ce2ccae1a19b49f17819e6b8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '411cf2effb4749ba8429e97e0fae2509', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7eb9fd7cb2ffaa398126cc3eef4ee3fe34f1f7254d2ce130851a93e154a154f3297cc87a23f8ba9dbd6b4e8f2559627e6708bbd9dfb8184153f237ed0f1bff64', 'id': '08240fee-aca8-4083-acc7-627ec8881cf9', 'created_at': datetime.datetime(2026, 7, 3, 22, 11, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 11, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08240fee-aca8-4083-acc7-627ec8881cf9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d22402de0>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029865bc-dafa-4cf0-86f8-44478fe00c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:34 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Volume volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 (4b47fc2c-ae55-4f2d-a3d0-e123e83c2898): created successfully
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (029865bc-dafa-4cf0-86f8-44478fe00c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Flow 'volume_create_manager' (dabec24a-5fbd-4917-8219-cee979262d91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-95eb9d3e-9625-4cf4-9845-27479a9e3be6 tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Created volume successfully.
Jul 04 00:11:34 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8d1e9130-182a-40e6-bd7e-49da4002097c" returned: 0 in 0.737s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.251s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1880016766',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeeaf072-34de-490f-b283-6aae343028e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0593506d22d94ecaa9d8518d96e851e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:20Z,use_quota=True,user_id='2904ae26d6114272b017dd744ef0b9dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Creating volume eeeaf072-34de-490f-b283-6aae343028e4 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:34 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-eeeaf072-34de-490f-b283-6aae343028e4 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:35 devstack sudo[104581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-eeeaf072-34de-490f-b283-6aae343028e4 1073741824
Jul 04 00:11:35 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da281da-c72c-4f26-b865-e229f82cada6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d1e9130-182a-40e6-bd7e-49da4002097c', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e132080d-feb2-4e19-b708-08385bb34c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:35 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume volume-8d1e9130-182a-40e6-bd7e-49da4002097c (8d1e9130-182a-40e6-bd7e-49da4002097c): created successfully
Jul 04 00:11:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e132080d-feb2-4e19-b708-08385bb34c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Flow 'volume_create_manager' (06b75e30-b072-435c-a738-07403bfa66eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:35 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8ebb898a-c396-4677-b892-02ddc6147af2 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created volume successfully.
Jul 04 00:11:35 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1" returned: 0 in 0.823s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:35 devstack sudo[104586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1
Jul 04 00:11:35 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Acquiring lock "cinder-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Lock "cinder-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Acquiring lock "cinder-quobyte-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Lock "cinder-quobyte-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:35 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0608d31f-333a-4197-ac50-bf843e7e1d4b]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:35 devstack sudo[104592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898
Jul 04 00:11:35 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:36 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-eeeaf072-34de-490f-b283-6aae343028e4 1073741824" returned: 0 in 1.064s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-eeeaf072-34de-490f-b283-6aae343028e4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:36 devstack sudo[104594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-eeeaf072-34de-490f-b283-6aae343028e4
Jul 04 00:11:36 devstack sudo[104594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:36 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1" returned: 0 in 0.901s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-quobyte-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1" released by "delete_volume" :: held 1.770s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Created reservations ['2b015f36-e429-4675-9c69-ca8af9b6c6a5', '6f0051de-d0b2-43ba-a447-55ad05d36b43', '6c7f06df-41b5-4b34-b9e0-a3a10017d698', '37b51024-281d-4e3f-9d29-9c3970655ca5'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:36 devstack sudo[104597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:36 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:36 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898" returned: 0 in 1.002s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:36 devstack sudo[104601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898
Jul 04 00:11:36 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "cinder-8eb58357-d642-4a41-bc28-aae2db522294-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-8eb58357-d642-4a41-bc28-aae2db522294-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "cinder-quobyte-8eb58357-d642-4a41-bc28-aae2db522294" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:37 devstack sudo[104594]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-eeeaf072-34de-490f-b283-6aae343028e4" returned: 0 in 0.981s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-quobyte-8eb58357-d642-4a41-bc28-aae2db522294" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a286d6-3aff-4848-b2b3-019c2ede09f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeeaf072-34de-490f-b283-6aae343028e4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d8c7c5-aa21-453a-8919-4583a904f7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[11403943-8eaa-4d1b-941f-031ae8a2731f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8eb58357-d642-4a41-bc28-aae2db522294 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:37 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Volume volume-eeeaf072-34de-490f-b283-6aae343028e4 (eeeaf072-34de-490f-b283-6aae343028e4): created successfully
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d8c7c5-aa21-453a-8919-4583a904f7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Flow 'volume_create_manager' (7391ab34-da04-48fb-8806-c4ff10f2da41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:37 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-61888521-19cf-41df-a833-b554f7f82f34 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created volume successfully.
Jul 04 00:11:37 devstack sudo[104604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8eb58357-d642-4a41-bc28-aae2db522294
Jul 04 00:11:37 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:37 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.974s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:37 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Deleted volume successfully.
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d28f5ade-1d07-4f2b-ab4a-d14b986a692c tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-d28f7f17-1ba7-41b1-ab0a-d4de44af6bb1-delete_volume" released by "delete_volume" :: held 3.000s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:37 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898" returned: 1 in 0.985s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:11:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:37 devstack sudo[104610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898
Jul 04 00:11:37 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:38 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8eb58357-d642-4a41-bc28-aae2db522294" returned: 0 in 1.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8eb58357-d642-4a41-bc28-aae2db522294 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:38 devstack sudo[104616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8eb58357-d642-4a41-bc28-aae2db522294
Jul 04 00:11:38 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-eeeaf072-34de-490f-b283-6aae343028e4-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-eeeaf072-34de-490f-b283-6aae343028e4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-quobyte-eeeaf072-34de-490f-b283-6aae343028e4" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-eeeaf072-34de-490f-b283-6aae343028e4" acquired by "delete_volume" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd81c3f-bb00-43a7-bf24-8773657c6c5a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-eeeaf072-34de-490f-b283-6aae343028e4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:38 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898" returned: 0 in 0.771s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Lock "cinder-quobyte-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898" released by "delete_volume" :: held 2.842s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:38 devstack sudo[104619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-eeeaf072-34de-490f-b283-6aae343028e4
Jul 04 00:11:38 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Created reservations ['6f5c4e0b-2242-41e9-be5d-df7d5245708d', '4c90b305-5577-4597-91ba-cb7cb698419c', 'a9b41af4-7f3b-4da0-8c67-9008f456d1b7', '0ef9b211-a5de-4a4b-af82-75e85d5e35a4'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:38 devstack sudo[104621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:38 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:39 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8eb58357-d642-4a41-bc28-aae2db522294" returned: 0 in 0.926s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-quobyte-8eb58357-d642-4a41-bc28-aae2db522294" released by "delete_volume" :: held 2.027s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Created reservations ['f29983e7-5613-4cd1-96b3-3cdbd193488a', '7338c623-a238-49e0-a5ea-b0f56180a52e', '66edc16e-292a-4642-bc0e-24e55ac9528b', 'b968aa01-f11d-4505-b1b8-e20d50239216'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:39 devstack sudo[104626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:39 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:39 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-eeeaf072-34de-490f-b283-6aae343028e4" returned: 0 in 1.303s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-eeeaf072-34de-490f-b283-6aae343028e4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:39 devstack sudo[104630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-eeeaf072-34de-490f-b283-6aae343028e4
Jul 04 00:11:39 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:39 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.206s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:39 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Deleted volume successfully.
Jul 04 00:11:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b6661084-99b0-4e40-a1fb-04f84d6d351c tempest-VolumeAndVolumeTypeFromImageTest-1482092133 None] Lock "cinder-4b47fc2c-ae55-4f2d-a3d0-e123e83c2898-delete_volume" released by "delete_volume" :: held 4.375s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:40 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.821s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:40 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:40 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Deleted volume successfully.
Jul 04 00:11:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-42dbf59b-e412-4dc3-87b0-7be2fbbb6d96 tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-8eb58357-d642-4a41-bc28-aae2db522294-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "cinder-1620e10b-5742-4335-94d7-344bd8c47a8a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-1620e10b-5742-4335-94d7-344bd8c47a8a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "cinder-quobyte-1620e10b-5742-4335-94d7-344bd8c47a8a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-quobyte-1620e10b-5742-4335-94d7-344bd8c47a8a" acquired by "delete_volume" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:40 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec2baee-9766-4186-b9a2-76a082fdc8d5]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1620e10b-5742-4335-94d7-344bd8c47a8a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:40 devstack sudo[104633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1620e10b-5742-4335-94d7-344bd8c47a8a
Jul 04 00:11:40 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:40 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-eeeaf072-34de-490f-b283-6aae343028e4" returned: 0 in 1.097s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-eeeaf072-34de-490f-b283-6aae343028e4" released by "delete_volume" :: held 2.459s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created reservations ['7811eb56-f0a6-4ef0-86f0-d74480faa81f', '490a2849-2f97-4fb4-a036-bed877e69022', '784efc96-6c6d-4e00-99d9-1f53d5f7baea', '8e0c1e35-3d2d-4d26-a845-8688344d78b0'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:41 devstack sudo[104638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:41 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:41 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1620e10b-5742-4335-94d7-344bd8c47a8a" returned: 0 in 1.113s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1620e10b-5742-4335-94d7-344bd8c47a8a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:41 devstack sudo[104643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1620e10b-5742-4335-94d7-344bd8c47a8a
Jul 04 00:11:41 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-8d1e9130-182a-40e6-bd7e-49da4002097c-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-8d1e9130-182a-40e6-bd7e-49da4002097c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-quobyte-8d1e9130-182a-40e6-bd7e-49da4002097c" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-8d1e9130-182a-40e6-bd7e-49da4002097c" acquired by "delete_volume" :: waited 0.028s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d119022-7e99-49ea-9e8f-de10d31a1ad9]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8d1e9130-182a-40e6-bd7e-49da4002097c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:41 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.799s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:42 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Deleted volume successfully.
Jul 04 00:11:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-cdccf69e-528b-437d-acfc-679cd9a4cb31 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-eeeaf072-34de-490f-b283-6aae343028e4-delete_volume" released by "delete_volume" :: held 3.669s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:42 devstack sudo[104646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8d1e9130-182a-40e6-bd7e-49da4002097c
Jul 04 00:11:42 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:42 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1620e10b-5742-4335-94d7-344bd8c47a8a" returned: 0 in 1.051s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-quobyte-1620e10b-5742-4335-94d7-344bd8c47a8a" released by "delete_volume" :: held 2.234s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:42 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Created reservations ['51eb07ad-7986-4d3a-ac24-0b266219c405', 'b0f57ef3-ab83-4254-932a-34a837c3b74e', '2ba36326-e95e-482d-a5b7-ecb8e3a5311d', '9949a4c8-a0a4-45f9-92d9-7390a6adf9c5'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:43 devstack sudo[104653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:43 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:43 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8d1e9130-182a-40e6-bd7e-49da4002097c" returned: 0 in 1.176s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8d1e9130-182a-40e6-bd7e-49da4002097c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:43 devstack sudo[104655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8d1e9130-182a-40e6-bd7e-49da4002097c
Jul 04 00:11:43 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:43 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.789s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:43 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:43 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Deleted volume successfully.
Jul 04 00:11:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e1bce720-938d-492b-b351-c678c2e5fa1f tempest-CreateVolumesFromSourceVolumeTest-935054259 None] Lock "cinder-1620e10b-5742-4335-94d7-344bd8c47a8a-delete_volume" released by "delete_volume" :: held 3.372s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:44 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8d1e9130-182a-40e6-bd7e-49da4002097c" returned: 0 in 0.916s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:44 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-8d1e9130-182a-40e6-bd7e-49da4002097c" released by "delete_volume" :: held 2.152s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:44 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created reservations ['6cf4ad22-2814-42a9-afec-4352fcc5190a', 'e51e5545-2c19-463d-9969-a4ee8427b0be', 'c596069f-9170-4f77-ae0c-40d018e0f04f', 'd59931c0-f96f-49a6-ad9a-91b0d6e1eb96'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:44 devstack sudo[104659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:44 devstack sudo[104659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:45 devstack sudo[104659]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.760s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:45 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Deleted volume successfully.
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9fc8b3fc-f528-459d-905c-8d962a119796 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-8d1e9130-182a-40e6-bd7e-49da4002097c-delete_volume" released by "delete_volume" :: held 3.228s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-a08b4b8a-7a02-4401-9793-9d204bb9c58a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-a08b4b8a-7a02-4401-9793-9d204bb9c58a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-quobyte-a08b4b8a-7a02-4401-9793-9d204bb9c58a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-a08b4b8a-7a02-4401-9793-9d204bb9c58a" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27acefa-1ac9-4b02-8f45-399465c57bca]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:45 devstack sudo[104662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a
Jul 04 00:11:45 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Flow 'volume_create_manager' (5fc3faf1-657c-4ba7-876b-bf60e25ef9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dc159d-a326-4a8a-b608-28745d860b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dc159d-a326-4a8a-b608-28745d860b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e451bc8c-f4d6-4ac4-9b1b-0bcd65544189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3941a6884b9843068e140b9dc5b59d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:46Z,use_quota=True,user_id='088055002ea24a16a310d94fec77d584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0651fe-3555-4842-a4ed-d4c405232872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0651fe-3555-4842-a4ed-d4c405232872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5646695c-3e68-4640-b047-0f56c94a4654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5646695c-3e68-4640-b047-0f56c94a4654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e451bc8c-f4d6-4ac4-9b1b-0bcd65544189', 'volume_name': 'volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8c69c9-c293-4b5a-bbca-005536736f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8c69c9-c293-4b5a-bbca-005536736f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85c1423-d3ac-4f5e-bddb-dcef3dd7b460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:45 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Volume e451bc8c-f4d6-4ac4-9b1b-0bcd65544189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189', 'volume_size': 1}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e451bc8c-f4d6-4ac4-9b1b-0bcd65544189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3941a6884b9843068e140b9dc5b59d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:46Z,use_quota=True,user_id='088055002ea24a16a310d94fec77d584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Creating volume e451bc8c-f4d6-4ac4-9b1b-0bcd65544189 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:45 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:45 devstack sudo[104664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189 1073741824
Jul 04 00:11:45 devstack sudo[104664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:46 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a" returned: 0 in 1.103s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:46 devstack sudo[104670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a
Jul 04 00:11:46 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:47 devstack sudo[104664]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189 1073741824" returned: 0 in 1.222s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:47 devstack sudo[104676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189
Jul 04 00:11:47 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:47 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-a08b4b8a-7a02-4401-9793-9d204bb9c58a" returned: 0 in 0.940s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-a08b4b8a-7a02-4401-9793-9d204bb9c58a" released by "delete_volume" :: held 2.110s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created reservations ['f931cb8a-b73a-4b21-bfc8-5341b1417225', '178eefaa-c3ba-4ace-a193-a7f454f04519', '6d7f27b7-8504-4125-a2e4-be56a0e27b4b', '976b7188-2d1f-4d89-83f4-cc41220ade8a'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:47 devstack sudo[104679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:47 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:47 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189" returned: 0 in 0.798s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85c1423-d3ac-4f5e-bddb-dcef3dd7b460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:47 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8f0f74-7f46-49ab-9558-4320e9ac45e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:48 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Volume volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189 (e451bc8c-f4d6-4ac4-9b1b-0bcd65544189): created successfully
Jul 04 00:11:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8f0f74-7f46-49ab-9558-4320e9ac45e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Flow 'volume_create_manager' (5fc3faf1-657c-4ba7-876b-bf60e25ef9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4465797e-a7ce-43fb-a172-16b3eaebd8a5 tempest-CinderUnicodeTest-340513323 None] Created volume successfully.
Jul 04 00:11:48 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.857s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:48 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Deleted volume successfully.
Jul 04 00:11:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-08860cbf-dab7-48e8-bb9e-429b44ad7f4b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-a08b4b8a-7a02-4401-9793-9d204bb9c58a-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-aa68af59-4160-4f7b-a81b-cf78f43f616c-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-aa68af59-4160-4f7b-a81b-cf78f43f616c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-quobyte-aa68af59-4160-4f7b-a81b-cf78f43f616c" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-aa68af59-4160-4f7b-a81b-cf78f43f616c" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:48 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf2d45b-1989-45d9-ad3a-a334efd49c93]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-aa68af59-4160-4f7b-a81b-cf78f43f616c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:49 devstack sudo[104683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-aa68af59-4160-4f7b-a81b-cf78f43f616c
Jul 04 00:11:49 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Flow 'volume_create_manager' (2dfc01ae-1fc0-4200-b78a-a740ec670580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5febb5-2a05-4c44-9170-e9f913f8862b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5febb5-2a05-4c44-9170-e9f913f8862b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1447453051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3941a6884b9843068e140b9dc5b59d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:50Z,use_quota=True,user_id='088055002ea24a16a310d94fec77d584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114d2620-d395-4064-8df8-16b79ed21fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114d2620-d395-4064-8df8-16b79ed21fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (315c8ca5-016d-4505-9907-923cfc38cc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (315c8ca5-016d-4505-9907-923cfc38cc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7', 'volume_name': 'volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22beff5b-9787-4a12-ab61-7a5c4259de70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22beff5b-9787-4a12-ab61-7a5c4259de70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5923794f-00c4-445b-a744-9b0f6b823f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:49 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Volume c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7', 'volume_size': 1}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1447453051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3941a6884b9843068e140b9dc5b59d73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:50Z,use_quota=True,user_id='088055002ea24a16a310d94fec77d584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Creating volume c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:49 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:49 devstack sudo[104688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 1073741824
Jul 04 00:11:49 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:50 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-aa68af59-4160-4f7b-a81b-cf78f43f616c" returned: 0 in 1.165s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-aa68af59-4160-4f7b-a81b-cf78f43f616c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:50 devstack sudo[104690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-aa68af59-4160-4f7b-a81b-cf78f43f616c
Jul 04 00:11:50 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:50 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-aa68af59-4160-4f7b-a81b-cf78f43f616c" returned: 0 in 0.838s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:50 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-aa68af59-4160-4f7b-a81b-cf78f43f616c" released by "delete_volume" :: held 2.072s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:50 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=120,cinder:UPDATE=177,cinder:INSERT=46,cinder:DELETE=19 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created reservations ['ec8195d3-3c38-42fb-a328-034736a1e4b2', '0a65a805-664d-4564-a8f0-6c8f7378387e', 'dd3a3076-db21-4379-bf0e-71dfe5f10e4c', 'e1d5d390-c7f0-4ad4-8ca3-a7203bed9200'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:51 devstack sudo[104698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:51 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-64fe0384-8059-4d27-822a-3bfd20335e17-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:51 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 1073741824" returned: 0 in 1.369s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=195,cinder:SELECT=137,cinder:INSERT=46,cinder:DELETE=16 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-64fe0384-8059-4d27-822a-3bfd20335e17-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Flow 'volume_create_manager' (7dfefe54-9989-4b77-a1b7-6cae0dc2ef0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c70518-304b-45d8-bbc7-8caf148f53da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c70518-304b-45d8-bbc7-8caf148f53da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154fbbe2-a73c-4562-a990-2456dd6909d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03e8e673b3f416f82a870f79788927c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:51Z,use_quota=True,user_id='aa99ea4e76544b2f8605dc65a2298ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4fcd0dd-d5d0-486a-a935-c5657e54f8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4fcd0dd-d5d0-486a-a935-c5657e54f8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3450504-7efd-4230-802c-23cfddaa440e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.image.glance [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Creating Keystone auth plugin from conf {{(pid=86648) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-quobyte-64fe0384-8059-4d27-822a-3bfd20335e17" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:51 devstack sudo[104700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7
Jul 04 00:11:51 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-64fe0384-8059-4d27-822a-3bfd20335e17" acquired by "delete_volume" :: waited 0.038s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7072208d-dbd5-4fcb-a7f5-e0425bee3589]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-64fe0384-8059-4d27-822a-3bfd20335e17 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:51 devstack sudo[104702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-64fe0384-8059-4d27-822a-3bfd20335e17
Jul 04 00:11:51 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:52 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3450504-7efd-4230-802c-23cfddaa440e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '154fbbe2-a73c-4562-a990-2456dd6909d5', 'volume_name': 'volume-154fbbe2-a73c-4562-a990-2456dd6909d5', 'volume_size': 1, 'image_id': '9bc55016-daeb-4eec-867c-ac847795bb69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc55016-daeb-4eec-867c-ac847795bb69', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd648797fbc14bc1e292e5d6b2943833a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b03e8e673b3f416f82a870f79788927c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9406e959dfa4ab4f15e7c32b9c15b83ab07bad52f9df98fc148df8d9bf7715183775adbe449392d8406b5e3f40be70f8ec2c6873529fb94d7c2c329cc385ee0e', 'id': '9bc55016-daeb-4eec-867c-ac847795bb69', 'created_at': datetime.datetime(2026, 7, 3, 22, 11, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 11, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc55016-daeb-4eec-867c-ac847795bb69/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c840bf0>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3230f63a-cdf3-43e3-8b39-78a49bcfbc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3230f63a-cdf3-43e3-8b39-78a49bcfbc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27af9826-eb55-419b-b81e-74c8b86cb0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:52 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Volume 154fbbe2-a73c-4562-a990-2456dd6909d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-154fbbe2-a73c-4562-a990-2456dd6909d5', 'volume_size': 1, 'image_id': '9bc55016-daeb-4eec-867c-ac847795bb69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc55016-daeb-4eec-867c-ac847795bb69', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd648797fbc14bc1e292e5d6b2943833a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b03e8e673b3f416f82a870f79788927c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9406e959dfa4ab4f15e7c32b9c15b83ab07bad52f9df98fc148df8d9bf7715183775adbe449392d8406b5e3f40be70f8ec2c6873529fb94d7c2c329cc385ee0e', 'id': '9bc55016-daeb-4eec-867c-ac847795bb69', 'created_at': datetime.datetime(2026, 7, 3, 22, 11, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 11, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc55016-daeb-4eec-867c-ac847795bb69/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c840bf0>}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Trying to clone 154fbbe2-a73c-4562-a990-2456dd6909d5 from image 9bc55016-daeb-4eec-867c-ac847795bb69 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9bc55016-daeb-4eec-867c-ac847795bb69', 'metadata': {}}]). {{(pid=86648) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.013s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:52 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Deleted volume successfully.
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c92ddf35-2213-49b3-a00e-62066ca2ac5b tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-aa68af59-4160-4f7b-a81b-cf78f43f616c-delete_volume" released by "delete_volume" :: held 3.459s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 04 00:11:52 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Image download 0.00 MB at 0.00 MB/s
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c94926-e7f7-49e7-9848-6031ba3f6966]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:52 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7" returned: 0 in 1.112s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] <== create_volume: return (2660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.664s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:52 devstack sudo[104705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD
Jul 04 00:11:52 devstack sudo[104705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5923794f-00c4-445b-a744-9b0f6b823f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c326d1-4827-4ebc-bfe1-dbf1f28a9fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:52 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Volume volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 (c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7): created successfully
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c326d1-4827-4ebc-bfe1-dbf1f28a9fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Flow 'volume_create_manager' (2dfc01ae-1fc0-4200-b78a-a740ec670580) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:52 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-15bd20df-9bd3-4020-99a8-4694a2e9a1df tempest-CinderUnicodeTest-340513323 None] Created volume successfully.
Jul 04 00:11:52 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-64fe0384-8059-4d27-822a-3bfd20335e17" returned: 0 in 1.112s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-64fe0384-8059-4d27-822a-3bfd20335e17 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:52 devstack sudo[104711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-64fe0384-8059-4d27-822a-3bfd20335e17
Jul 04 00:11:52 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:53 devstack sudo[104705]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD" returned: 0 in 0.944s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] Creating offline snapshot c2a43efe-c3c1-436d-a440-739c05c549d0 of volume c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:11:53 devstack sudo[104715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD
Jul 04 00:11:53 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[88af51a5-f41b-4ce1-840e-f9da5c10f8a4]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:53 devstack sudo[104717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7
Jul 04 00:11:53 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:53 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-64fe0384-8059-4d27-822a-3bfd20335e17" returned: 0 in 0.961s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-64fe0384-8059-4d27-822a-3bfd20335e17" released by "delete_volume" :: held 2.142s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created reservations ['982587cb-aa5e-499a-a426-aaadd4056fb4', '4f72ba99-62a1-4642-9ff8-9f88265fce2c', 'b6f6de58-64e3-4f41-89a7-df6597799382', '59302e63-bfc0-4b72-a057-4ea57571acd4'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:53 devstack sudo[104720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:11:53 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:54 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD" returned: 1 in 0.975s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Temporary image 9bc55016-daeb-4eec-867c-ac847795bb69 is fetched for user aa99ea4e76544b2f8605dc65a2298ccf. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[be799a75-f7a0-4098-b5f2-2437a1db2172]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:54 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7" returned: 0 in 0.976s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:54 devstack sudo[104730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0 1G
Jul 04 00:11:54 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:54 devstack sudo[104728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD
Jul 04 00:11:54 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:54 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.771s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:54 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Deleted volume successfully.
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-caed9d1a-83a9-450f-a347-19bbb692e76a tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-64fe0384-8059-4d27-822a-3bfd20335e17-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-4c5d5b9c-751b-4c06-ace0-85ee04e8658f-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-4c5d5b9c-751b-4c06-ace0-85ee04e8658f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-quobyte-596c9093-e31f-49be-a790-602396b94ee3" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-596c9093-e31f-49be-a790-602396b94ee3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-quobyte-4c5d5b9c-751b-4c06-ace0-85ee04e8658f" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-4c5d5b9c-751b-4c06-ace0-85ee04e8658f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Deleting offline snapshot 4c5d5b9c-751b-4c06-ace0-85ee04e8658f of volume 596c9093-e31f-49be-a790-602396b94ee3 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] snapshot_file for this snap is: volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aba49a-df75-406a-b3e4-d2a289eec3a4]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:54 devstack sudo[104733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f
Jul 04 00:11:54 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:55 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD" returned: 0 in 0.985s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:55 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0 1G" returned: 0 in 0.939s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:55 devstack sudo[104742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0
Jul 04 00:11:55 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:55 devstack sudo[104741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD
Jul 04 00:11:55 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:55 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f" returned: 0 in 0.870s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:55 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-596c9093-e31f-49be-a790-602396b94ee3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:11:55 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[618619f0-de9c-455c-a4b6-7570d97f19f3]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:55 devstack sudo[104748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3
Jul 04 00:11:55 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:56 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD" returned: 1 in 0.940s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:11:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:56 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0" returned: 0 in 0.955s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:56 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0 is being set with open permissions: ugo+rw
Jul 04 00:11:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:56 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0
Jul 04 00:11:56 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:56 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3" returned: 0 in 0.894s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:56 devstack sudo[104762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f
Jul 04 00:11:56 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:57 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0" returned: 0 in 0.725s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:57 devstack sudo[104765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.info
Jul 04 00:11:57 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:57 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f" returned: 0 in 0.834s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:57 devstack sudo[104770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f
Jul 04 00:11:57 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:57 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.info" returned: 0 in 0.775s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:57 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.info is being set with open permissions: ugo+rw
Jul 04 00:11:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:57 devstack sudo[104773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.info
Jul 04 00:11:57 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:58 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3.4c5d5b9c-751b-4c06-ace0-85ee04e8658f" returned: 0 in 0.696s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-4c5d5b9c-751b-4c06-ace0-85ee04e8658f" released by "_delete_snapshot" :: held 3.414s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-596c9093-e31f-49be-a790-602396b94ee3" released by "delete_snapshot" :: held 3.444s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created reservations ['207ebe40-d362-4a1c-8dcb-531059f9b527', '473b1701-5603-4035-af20-86fc62cab58d', 'f8abaa2d-00c7-4077-a2f3-6eca28183357', '67a295a1-a069-4740-97d2-102a82df2fef'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:58 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Delete snapshot completed successfully.
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3138bccb-70e3-49fd-9073-c96dfd4e8435 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-4c5d5b9c-751b-4c06-ace0-85ee04e8658f-delete_snapshot" released by "delete_snapshot" :: held 3.620s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:58 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.info" returned: 0 in 0.801s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.307s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.396s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154fbbe2-a73c-4562-a990-2456dd6909d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b03e8e673b3f416f82a870f79788927c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:51Z,use_quota=True,user_id='aa99ea4e76544b2f8605dc65a2298ccf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Creating volume 154fbbe2-a73c-4562-a990-2456dd6909d5 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:58 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:11:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:58 devstack sudo[104777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 1073741824
Jul 04 00:11:58 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:58 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2944e974-3e01-4eca-a1b7-686f1f782705 tempest-CinderUnicodeTest-340513323 None] Create snapshot completed successfully
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-596c9093-e31f-49be-a790-602396b94ee3-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-596c9093-e31f-49be-a790-602396b94ee3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "cinder-quobyte-596c9093-e31f-49be-a790-602396b94ee3" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-596c9093-e31f-49be-a790-602396b94ee3" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc010e2-47bc-4877-88a6-c5b5978c85eb]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:59 devstack sudo[104779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3
Jul 04 00:11:59 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:59 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 1073741824" returned: 0 in 0.975s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:59 devstack sudo[104784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5
Jul 04 00:11:59 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Acquiring lock "cinder-c2a43efe-c3c1-436d-a440-739c05c549d0-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Lock "cinder-c2a43efe-c3c1-436d-a440-739c05c549d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Acquiring lock "cinder-quobyte-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Lock "cinder-quobyte-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Acquiring lock "cinder-quobyte-c2a43efe-c3c1-436d-a440-739c05c549d0" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Lock "cinder-quobyte-c2a43efe-c3c1-436d-a440-739c05c549d0" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Deleting offline snapshot c2a43efe-c3c1-436d-a440-739c05c549d0 of volume c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] snapshot_file for this snap is: volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7918531-b5e4-422c-989f-fafb42df0a0a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:00 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3" returned: 0 in 0.943s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:00 devstack sudo[104789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0
Jul 04 00:12:00 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:00 devstack sudo[104791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3
Jul 04 00:12:00 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:00 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5" returned: 0 in 0.853s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:12:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:00 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Attempting download of 9bc55016-daeb-4eec-867c-ac847795bb69 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bc55016-daeb-4eec-867c-ac847795bb69', 'metadata': {}}])) to volume 154fbbe2-a73c-4562-a990-2456dd6909d5. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 04 00:12:00 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdf7cc9-a66e-42fe-9d24-61a551603d68]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc55016-daeb-4eec-867c-ac847795bb69_6v5ygnqv {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0" returned: 0 in 0.902s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:00 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:12:00 devstack sudo[104797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc55016-daeb-4eec-867c-ac847795bb69_6v5ygnqv
Jul 04 00:12:00 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:00 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf94ff0-cc09-40e5-bdc8-2f699b41b82f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:01 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-596c9093-e31f-49be-a790-602396b94ee3" returned: 0 in 0.974s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:01 devstack sudo[104801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7
Jul 04 00:12:01 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:01 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-quobyte-596c9093-e31f-49be-a790-602396b94ee3" released by "delete_volume" :: held 1.988s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:01 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Created reservations ['6360f606-3a9a-4053-8e67-e0493fb2209e', '7fb1ca5d-b13c-420b-abeb-d85663b62e99', 'fcac65cc-cb20-489d-a67d-9b4f2f9f8757', 'afd7305d-964c-43ad-8a4d-c0b242086b53'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:12:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:01 devstack sudo[104803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:12:01 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:01 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9bc55016-daeb-4eec-867c-ac847795bb69_6v5ygnqv" returned: 0 in 1.175s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc55016-daeb-4eec-867c-ac847795bb69_6v5ygnqv {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:02 devstack sudo[104810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc55016-daeb-4eec-867c-ac847795bb69_6v5ygnqv
Jul 04 00:12:02 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:02 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7" returned: 0 in 1.242s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:02 devstack sudo[104813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0
Jul 04 00:12:02 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:02 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.088s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:02 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:12:02 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Deleted volume successfully.
Jul 04 00:12:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-971ad48b-679b-49a5-b154-3d90a0b89030 tempest-CreateVolumesFromSnapshotTest-1264316038 None] Lock "cinder-596c9093-e31f-49be-a790-602396b94ee3-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:02 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc55016-daeb-4eec-867c-ac847795bb69_6v5ygnqv" returned: 1 in 1.072s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9bc55016-daeb-4eec-867c-ac847795bb69_6v5ygnqv' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:12:03 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4749cc-829c-4fe6-b3dd-4bc0621e725f]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:03 devstack sudo[104822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD
Jul 04 00:12:03 devstack sudo[104822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:03 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0" returned: 0 in 1.053s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:03 devstack sudo[104824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0
Jul 04 00:12:03 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:04 devstack sudo[104822]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD" returned: 0 in 1.066s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:04 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7.c2a43efe-c3c1-436d-a440-739c05c549d0" returned: 0 in 0.884s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Lock "cinder-quobyte-c2a43efe-c3c1-436d-a440-739c05c549d0" released by "_delete_snapshot" :: held 4.272s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Lock "cinder-quobyte-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7" released by "delete_snapshot" :: held 4.312s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:04 devstack sudo[104829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD
Jul 04 00:12:04 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:04 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Created reservations ['030da815-a46f-4b79-a84d-2b639b5d12a3', '6442d13a-34b9-431f-b924-f63aca5b7a60', '84136b2a-5f9f-474e-95f8-c579e6cf953e', '0ec67540-ab07-4cc0-85c1-22171d4f6edb'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:12:04 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Delete snapshot completed successfully.
Jul 04 00:12:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d641dd13-ca26-412b-a4d6-5dbd6ac5fdfc tempest-CinderUnicodeTest-340513323 None] Lock "cinder-c2a43efe-c3c1-436d-a440-739c05c549d0-delete_snapshot" released by "delete_snapshot" :: held 4.482s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:04 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD" returned: 1 in 0.893s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:12:04 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] 9bc55016-daeb-4eec-867c-ac847795bb69 was raw, converting to raw {{(pid=86648) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 04 00:12:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:05 devstack sudo[104834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5
Jul 04 00:12:05 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:05 devstack sudo[104836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:12:05 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Acquiring lock "cinder-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Lock "cinder-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Acquiring lock "cinder-quobyte-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Flow 'volume_create_manager' (bbec1e07-8942-4079-af80-0e66da26d602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fed0e9b-5d33-4eff-815b-59332897883c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fed0e9b-5d33-4eff-815b-59332897883c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1210255940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010e148a-a5c4-418c-a7a6-f0385ba4a48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d501a76969b84449bea761dcdf986e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:05Z,use_quota=True,user_id='dd950c8a40f944ff96ac833037a654e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9ddbdf-233a-40c1-965d-c5388eaefadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9ddbdf-233a-40c1-965d-c5388eaefadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28036de-f97b-4372-bed5-f19d26c74d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28036de-f97b-4372-bed5-f19d26c74d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010e148a-a5c4-418c-a7a6-f0385ba4a48f', 'volume_name': 'volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f07cc51-d462-48ec-9152-3d7169df8cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f07cc51-d462-48ec-9152-3d7169df8cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7437354-75e0-4526-a336-4b1561ae1b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:05 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Volume 010e148a-a5c4-418c-a7a6-f0385ba4a48f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f', 'volume_size': 1}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1210255940',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=010e148a-a5c4-418c-a7a6-f0385ba4a48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d501a76969b84449bea761dcdf986e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:05Z,use_quota=True,user_id='dd950c8a40f944ff96ac833037a654e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Creating volume 010e148a-a5c4-418c-a7a6-f0385ba4a48f {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:12:05 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Lock "cinder-quobyte-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7" acquired by "delete_volume" :: waited 0.162s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:05 devstack sudo[104840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f 1073741824
Jul 04 00:12:05 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dffc06a-04bc-490a-9a5a-6d6588050c1c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:05 devstack sudo[104842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7
Jul 04 00:12:05 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:06 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5" returned: 0 in 1.093s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:06 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9bc55016-daeb-4eec-867c-ac847795bb69_87cu3zrcdevstack@QuobyteHD, size 0.00 MB, duration 1.10 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:12:06 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Converted 0.00 MB image at 0.00 MB/s
Jul 04 00:12:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:06 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.913s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:06 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:12:06 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:12:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:12:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:12:06 devstack sudo[104848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 1G
Jul 04 00:12:06 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:06 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f 1073741824" returned: 0 in 1.384s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:06 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7" returned: 0 in 1.362s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:07 devstack sudo[104858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7
Jul 04 00:12:07 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:07 devstack sudo[104860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f
Jul 04 00:12:07 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:07 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 1G" returned: 0 in 1.058s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[89192211-31cb-43b4-b311-0bdbaf5a7152]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:07 devstack sudo[104865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5
Jul 04 00:12:07 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:07 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f" returned: 0 in 0.791s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] <== create_volume: return (2252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.255s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:07 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7" returned: 0 in 0.824s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7437354-75e0-4526-a336-4b1561ae1b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b59534-5d3e-4cf1-b17e-4549a5812627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Lock "cinder-quobyte-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7" released by "delete_volume" :: held 2.282s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:07 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Volume volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f (010e148a-a5c4-418c-a7a6-f0385ba4a48f): created successfully
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b59534-5d3e-4cf1-b17e-4549a5812627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Flow 'volume_create_manager' (bbec1e07-8942-4079-af80-0e66da26d602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:07 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ec20f86b-2d36-4be1-bc29-2e2287319595 tempest-VolumeDependencyTests-495732398 None] Created volume successfully.
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Created reservations ['08571792-fc43-43e8-b7ee-c76c803d5b01', '2d5b33fb-af30-4b6b-82c6-9deb4c6e3a8c', '3b824495-a58f-43cf-bcf6-e917b0d87d70', '84eba463-f78b-486e-80a5-aa19ff0affd2'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:08 devstack sudo[104869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:12:08 devstack sudo[104869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:08 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5" returned: 0 in 0.937s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:08 devstack sudo[104873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5
Jul 04 00:12:08 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:08 devstack sudo[104869]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.691s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:08 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:12:08 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Deleted volume successfully.
Jul 04 00:12:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-07f6334a-f3c7-41ab-8885-fe9cbf3ceb93 tempest-CinderUnicodeTest-340513323 None] Lock "cinder-c6d4bdab-e929-49bb-9b5f-ffd3f42dc5b7-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Acquiring lock "cinder-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:08 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] Creating offline snapshot c345a321-6f0c-40a3-af46-c30a62b069f0 of volume 010e148a-a5c4-418c-a7a6-f0385ba4a48f {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:12:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Lock "cinder-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[255d8dd8-8e95-48c4-b6f1-e9473dc8a964]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Acquiring lock "cinder-quobyte-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Lock "cinder-quobyte-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189" acquired by "delete_volume" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b67def0-e1db-4eaf-ace6-fb4f3b35bfe5]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:09 devstack sudo[104878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f
Jul 04 00:12:09 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:09 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5" returned: 1 in 1.049s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Downloaded image 9bc55016-daeb-4eec-867c-ac847795bb69 ((None, [{'url': 'file:///opt/stack/data/glance/images/9bc55016-daeb-4eec-867c-ac847795bb69', 'metadata': {}}])) to volume 154fbbe2-a73c-4562-a990-2456dd6909d5 successfully. {{(pid=86648) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Temporary image 9bc55016-daeb-4eec-867c-ac847795bb69 for user aa99ea4e76544b2f8605dc65a2298ccf is deleted. {{(pid=86648) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG cinder.volume.volume_utils [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Marking volume 154fbbe2-a73c-4562-a990-2456dd6909d5 as bootable. {{(pid=86648) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Copying metadata from image 9bc55016-daeb-4eec-867c-ac847795bb69 to 154fbbe2-a73c-4562-a990-2456dd6909d5. {{(pid=86648) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Creating volume glance metadata for volume 154fbbe2-a73c-4562-a990-2456dd6909d5 backed by image 9bc55016-daeb-4eec-867c-ac847795bb69 with: {'image_id': '9bc55016-daeb-4eec-867c-ac847795bb69', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd648797fbc14bc1e292e5d6b2943833a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86648) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 04 00:12:09 devstack sudo[104880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189
Jul 04 00:12:09 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27af9826-eb55-419b-b81e-74c8b86cb0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154fbbe2-a73c-4562-a990-2456dd6909d5', 'volume_size': 1, 'image_id': '9bc55016-daeb-4eec-867c-ac847795bb69', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9bc55016-daeb-4eec-867c-ac847795bb69', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd648797fbc14bc1e292e5d6b2943833a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b03e8e673b3f416f82a870f79788927c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9406e959dfa4ab4f15e7c32b9c15b83ab07bad52f9df98fc148df8d9bf7715183775adbe449392d8406b5e3f40be70f8ec2c6873529fb94d7c2c329cc385ee0e', 'id': '9bc55016-daeb-4eec-867c-ac847795bb69', 'created_at': datetime.datetime(2026, 7, 3, 22, 11, 48, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 11, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9bc55016-daeb-4eec-867c-ac847795bb69/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x770d2c840bf0>}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cab0c0d-4c66-4fe1-8d5b-4411fd357790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:09 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Volume volume-154fbbe2-a73c-4562-a990-2456dd6909d5 (154fbbe2-a73c-4562-a990-2456dd6909d5): created successfully
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cab0c0d-4c66-4fe1-8d5b-4411fd357790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:09 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Flow 'volume_create_manager' (7dfefe54-9989-4b77-a1b7-6cae0dc2ef0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f6895009-66a9-4030-8fdb-c42505acbc49 tempest-VolumeImageDependencyTests-1617344572 None] Created volume successfully.
Jul 04 00:12:09 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f" returned: 0 in 0.995s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:10 devstack sudo[104891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0 1G
Jul 04 00:12:10 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:10 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189" returned: 0 in 0.944s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:10 devstack sudo[104893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189
Jul 04 00:12:10 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Acquiring lock "cinder-154fbbe2-a73c-4562-a990-2456dd6909d5-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Lock "cinder-154fbbe2-a73c-4562-a990-2456dd6909d5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Acquiring lock "cinder-quobyte-154fbbe2-a73c-4562-a990-2456dd6909d5" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Lock "cinder-quobyte-154fbbe2-a73c-4562-a990-2456dd6909d5" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:10 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd87da55-b17b-45ab-a855-2f1c8339b5f0]: (4, 'raw') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:10 devstack sudo[104895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5
Jul 04 00:12:10 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:11 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:11 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0 1G" returned: 0 in 1.040s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189" returned: 0 in 1.001s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Lock "cinder-quobyte-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189" released by "delete_volume" :: held 2.013s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:11 devstack sudo[104902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0
Jul 04 00:12:11 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Created reservations ['cc917710-df1c-464b-bb8d-3e59605fa2a7', '50d09a6d-37ec-4ce2-afdd-e46e9484b563', '8dc36dbe-afbd-4c70-af06-87dbc876715e', '057c5b66-2306-4685-a558-e9206e1683c6'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:12:11 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5" returned: 0 in 0.951s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:11 devstack sudo[104907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:12:11 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:11 devstack sudo[104906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5
Jul 04 00:12:11 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:11 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0" returned: 0 in 0.901s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:11 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0 is being set with open permissions: ugo+rw
Jul 04 00:12:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:11 devstack sudo[104913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0
Jul 04 00:12:11 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:12 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5" returned: 1 in 0.960s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5' failed. Not Retrying. {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:12:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:12 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.966s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:12 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:12:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Deleted volume successfully.
Jul 04 00:12:12 devstack sudo[104919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5
Jul 04 00:12:12 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-17850773-8371-4019-985f-1d7c41c54999 tempest-CinderUnicodeTest-340513323 None] Lock "cinder-e451bc8c-f4d6-4ac4-9b1b-0bcd65544189-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:12 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0" returned: 0 in 0.979s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:12 devstack sudo[104923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.info
Jul 04 00:12:12 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:13 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-154fbbe2-a73c-4562-a990-2456dd6909d5" returned: 0 in 0.865s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Lock "cinder-quobyte-154fbbe2-a73c-4562-a990-2456dd6909d5" released by "delete_volume" :: held 2.878s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:13 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Created reservations ['d2a524d7-bc57-422f-a6f7-aece796dd3b4', '18d54614-f010-4347-828d-3c13f9414bc7', '569013a0-9280-4826-8bb5-fb370bdcd8c0', '670a9d26-bb15-424f-a14a-df30864e07bb'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:12:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:13 devstack sudo[104925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:12:13 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:13 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.info" returned: 0 in 1.006s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:13 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.info is being set with open permissions: ugo+rw
Jul 04 00:12:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:14 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.info
Jul 04 00:12:14 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:14 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 1.116s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:14 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:12:14 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Deleted volume successfully.
Jul 04 00:12:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-da3cee10-1006-45f3-a4ed-3570fe9c2b18 tempest-VolumeImageDependencyTests-1617344572 None] Lock "cinder-154fbbe2-a73c-4562-a990-2456dd6909d5-delete_volume" released by "delete_volume" :: held 4.369s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:15 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.info" returned: 0 in 1.057s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.149s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:15 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-868643e3-23d2-4ba6-85fa-f49345686383 tempest-VolumeDependencyTests-495732398 None] Create snapshot completed successfully
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Flow 'volume_create_manager' (20251350-6d08-4857-845f-0ae723289322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9608de3-7c29-446c-853f-fd40c5d3bd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9608de3-7c29-446c-853f-fd40c5d3bd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1455369421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3437c705-3e60-4f28-ab8f-6ed11f370ad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d501a76969b84449bea761dcdf986e3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c345a321-6f0c-40a3-af46-c30a62b069f0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:16Z,use_quota=True,user_id='dd950c8a40f944ff96ac833037a654e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85e6752-20a9-410b-96a6-106f4bac0895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85e6752-20a9-410b-96a6-106f4bac0895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4652a6-f382-4ac5-8a0b-e8f9f4e183cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd4652a6-f382-4ac5-8a0b-e8f9f4e183cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3437c705-3e60-4f28-ab8f-6ed11f370ad5', 'volume_name': 'volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5', 'volume_size': 1, 'snapshot_id': 'c345a321-6f0c-40a3-af46-c30a62b069f0'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92489bd6-8da6-4ddc-8adf-b5c4d3149b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92489bd6-8da6-4ddc-8adf-b5c4d3149b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ade3bc-2182-4474-928d-bab7980ed112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:16 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Volume 3437c705-3e60-4f28-ab8f-6ed11f370ad5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5', 'volume_size': 1, 'snapshot_id': 'c345a321-6f0c-40a3-af46-c30a62b069f0'}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Acquiring lock "cinder-quobyte-c345a321-6f0c-40a3-af46-c30a62b069f0-3437c705-3e60-4f28-ab8f-6ed11f370ad5" by "_create_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Lock "cinder-quobyte-c345a321-6f0c-40a3-af46-c30a62b069f0-3437c705-3e60-4f28-ab8f-6ed11f370ad5" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Creating volume 3437c705-3e60-4f28-ab8f-6ed11f370ad5 from snapshot c345a321-6f0c-40a3-af46-c30a62b069f0 {{(pid=86648) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Acquiring lock "cinder-quobyte-3437c705-3e60-4f28-ab8f-6ed11f370ad5" by "_copy_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Lock "cinder-quobyte-3437c705-3e60-4f28-ab8f-6ed11f370ad5" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] snapshot: c345a321-6f0c-40a3-af46-c30a62b069f0, volume: 3437c705-3e60-4f28-ab8f-6ed11f370ad5,  {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db159a1-a63e-4200-baef-f32f84cfb136]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:16 devstack sudo[104932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0
Jul 04 00:12:16 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:17 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0" returned: 0 in 1.010s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:12:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] will copy from snapshot at /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:12:17 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Creating direct copy from snapshot {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:12:17 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c460c62-6a65-4877-8bc4-b4daa038d66f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:17 devstack sudo[104937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f
Jul 04 00:12:17 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:18 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:18 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-9799721f-496f-4a3b-8ce8-54ebd9c5f166 tempest-ProjectAdminTests-568735487 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86648) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 04 00:12:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f" returned: 0 in 0.993s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:18 devstack cinder-volume[86648]: DEBUG cinder.utils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Path /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5 not found in is_blk_device check {{(pid=86648) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:12:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:18 devstack sudo[104978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5
Jul 04 00:12:18 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:25 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5" returned: 0 in 6.740s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:25 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c3b110-73e7-4f31-8534-2367395276a7]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:25 devstack sudo[104992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f
Jul 04 00:12:25 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:26 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:DELETE=7,cinder:UPDATE=63,cinder:SELECT=52,cinder:INSERT=21 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:12:26 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:INSERT=23,cinder:UPDATE=72,cinder:SELECT=60,cinder:DELETE=4 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:12:26 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f" returned: 0 in 1.372s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:26 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f, size 1024.00 MB, duration 6.74 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5 {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:12:26 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Converted 1024.00 MB image at 151.88 MB/s
Jul 04 00:12:26 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5 is being set with open permissions: ugo+rw
Jul 04 00:12:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:26 devstack sudo[105003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5
Jul 04 00:12:26 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:27 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5" returned: 0 in 0.895s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Lock "cinder-quobyte-3437c705-3e60-4f28-ab8f-6ed11f370ad5" released by "_copy_volume_from_snapshot" :: held 11.197s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Lock "cinder-quobyte-c345a321-6f0c-40a3-af46-c30a62b069f0-3437c705-3e60-4f28-ab8f-6ed11f370ad5" released by "_create_volume_from_snapshot" :: held 11.239s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.263s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ade3bc-2182-4474-928d-bab7980ed112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5', 'volume_size': 1, 'snapshot_id': 'c345a321-6f0c-40a3-af46-c30a62b069f0'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3af5467-4d04-4341-9327-9792888b75cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:27 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Volume volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5 (3437c705-3e60-4f28-ab8f-6ed11f370ad5): created successfully
Jul 04 00:12:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3af5467-4d04-4341-9327-9792888b75cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Flow 'volume_create_manager' (20251350-6d08-4857-845f-0ae723289322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d04556af-b2eb-4f96-92a2-ed100cdd3e10 tempest-VolumeDependencyTests-495732398 None] Created volume successfully.
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (84efe6b6-c30a-46c6-b6d0-30c4fefbaaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b66d6d-b34f-479a-ba00-0c092e7ea83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b66d6d-b34f-479a-ba00-0c092e7ea83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1556910895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398aa2d8-5146-4610-9dd1-35d7c638286e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:28Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6a924f-173f-458b-b84f-ec757e649639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6a924f-173f-458b-b84f-ec757e649639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d480883-0967-4eaa-a9f4-efbff40ac958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d480883-0967-4eaa-a9f4-efbff40ac958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398aa2d8-5146-4610-9dd1-35d7c638286e', 'volume_name': 'volume-398aa2d8-5146-4610-9dd1-35d7c638286e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2702ed-a324-40e2-91a3-e370160d3f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2702ed-a324-40e2-91a3-e370160d3f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d196c4-db0e-411a-bd8e-423af41ca947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:28 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Volume 398aa2d8-5146-4610-9dd1-35d7c638286e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398aa2d8-5146-4610-9dd1-35d7c638286e', 'volume_size': 1}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1556910895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398aa2d8-5146-4610-9dd1-35d7c638286e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:28Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Creating volume 398aa2d8-5146-4610-9dd1-35d7c638286e {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:12:28 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Acquiring lock "cinder-c345a321-6f0c-40a3-af46-c30a62b069f0-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Lock "cinder-c345a321-6f0c-40a3-af46-c30a62b069f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Acquiring lock "cinder-quobyte-010e148a-a5c4-418c-a7a6-f0385ba4a48f" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:28 devstack sudo[105006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e 1073741824
Jul 04 00:12:28 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Lock "cinder-quobyte-010e148a-a5c4-418c-a7a6-f0385ba4a48f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Acquiring lock "cinder-quobyte-c345a321-6f0c-40a3-af46-c30a62b069f0" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Lock "cinder-quobyte-c345a321-6f0c-40a3-af46-c30a62b069f0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Deleting offline snapshot c345a321-6f0c-40a3-af46-c30a62b069f0 of volume 010e148a-a5c4-418c-a7a6-f0385ba4a48f {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] snapshot_file for this snap is: volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[160763a4-8d28-4006-aaa9-f5b34fb1b0e0]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:28 devstack sudo[105008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0
Jul 04 00:12:28 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:29 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e 1073741824" returned: 0 in 1.419s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:30 devstack sudo[105018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e
Jul 04 00:12:30 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:30 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0" returned: 0 in 1.466s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:12:30 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5863b5f9-bd9d-4b23-931b-6aac25e75874]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:30 devstack sudo[105020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f
Jul 04 00:12:30 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:31 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e" returned: 0 in 1.088s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] <== create_volume: return (2607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.610s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d196c4-db0e-411a-bd8e-423af41ca947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398aa2d8-5146-4610-9dd1-35d7c638286e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09407c6-97e7-42e7-bdf3-403392e1b23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:31 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Volume volume-398aa2d8-5146-4610-9dd1-35d7c638286e (398aa2d8-5146-4610-9dd1-35d7c638286e): created successfully
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09407c6-97e7-42e7-bdf3-403392e1b23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (84efe6b6-c30a-46c6-b6d0-30c4fefbaaea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:31 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4882754e-7e2a-4192-b8b0-f37f7231edfa tempest-ProjectMemberTests-1651402342 None] Created volume successfully.
Jul 04 00:12:31 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f" returned: 0 in 1.222s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:31 devstack sudo[105027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0
Jul 04 00:12:31 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Flow 'volume_create_manager' (15eb5f63-93d4-485d-961f-ae095caedba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab54c34c-84e0-44da-b9fd-544b38f74a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab54c34c-84e0-44da-b9fd-544b38f74a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1247933952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50944ce5-3f8f-41d0-9096-e4e8abc54287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428202492bd04a078316f65d579e8ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:32Z,use_quota=True,user_id='55d2e28510054156b21fe713989f0776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bee589b-8439-4169-9fdf-e342a05565a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bee589b-8439-4169-9fdf-e342a05565a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec2565d-220b-4af8-8e27-3039b5fc4fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec2565d-220b-4af8-8e27-3039b5fc4fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50944ce5-3f8f-41d0-9096-e4e8abc54287', 'volume_name': 'volume-50944ce5-3f8f-41d0-9096-e4e8abc54287', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553c8e90-9254-4d16-809e-663cc5d54935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553c8e90-9254-4d16-809e-663cc5d54935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd89f219-98bf-4e05-a1e4-888170f10076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:31 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Volume 50944ce5-3f8f-41d0-9096-e4e8abc54287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50944ce5-3f8f-41d0-9096-e4e8abc54287', 'volume_size': 1}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1247933952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50944ce5-3f8f-41d0-9096-e4e8abc54287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428202492bd04a078316f65d579e8ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:32Z,use_quota=True,user_id='55d2e28510054156b21fe713989f0776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Creating volume 50944ce5-3f8f-41d0-9096-e4e8abc54287 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:12:31 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:12:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-50944ce5-3f8f-41d0-9096-e4e8abc54287 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:31 devstack sudo[105029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-50944ce5-3f8f-41d0-9096-e4e8abc54287 1073741824
Jul 04 00:12:31 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:32 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0" returned: 0 in 1.052s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:32 devstack sudo[105037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0
Jul 04 00:12:32 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Flow 'volume_create_manager' (718020ef-08a2-4c74-afa8-63fb8b5db4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cca2461-5e13-401a-8ac2-4a877bfe5585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cca2461-5e13-401a-8ac2-4a877bfe5585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1215637133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6873d00c-e1ad-4c2e-8d20-30034685d524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fec01d9408c47f1af304b7927b3b841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:33Z,use_quota=True,user_id='8909de9402664743a46c3db75033e835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e2c489-33a9-4220-bec7-678b1f5ba210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e2c489-33a9-4220-bec7-678b1f5ba210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4027975-4eb2-490f-8b80-14263be1fdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4027975-4eb2-490f-8b80-14263be1fdb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6873d00c-e1ad-4c2e-8d20-30034685d524', 'volume_name': 'volume-6873d00c-e1ad-4c2e-8d20-30034685d524', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec33d0e8-b203-4111-b4f7-d88a908be46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec33d0e8-b203-4111-b4f7-d88a908be46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259d04bb-7fd6-4c0e-afa8-ecc8c25c7ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:32 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Volume 6873d00c-e1ad-4c2e-8d20-30034685d524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6873d00c-e1ad-4c2e-8d20-30034685d524', 'volume_size': 1}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:32 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-50944ce5-3f8f-41d0-9096-e4e8abc54287 1073741824" returned: 0 in 0.941s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-50944ce5-3f8f-41d0-9096-e4e8abc54287 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:32 devstack sudo[105041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-50944ce5-3f8f-41d0-9096-e4e8abc54287
Jul 04 00:12:32 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:33 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f.c345a321-6f0c-40a3-af46-c30a62b069f0" returned: 0 in 0.674s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Lock "cinder-quobyte-c345a321-6f0c-40a3-af46-c30a62b069f0" released by "_delete_snapshot" :: held 4.603s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Lock "cinder-quobyte-010e148a-a5c4-418c-a7a6-f0385ba4a48f" released by "delete_snapshot" :: held 4.632s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Created reservations ['4c7c1a3e-dffb-4811-adc5-729fbe870940', '5cf90882-bc8e-4be5-9632-1d9e8553c511', '002d17cd-1239-43f4-8b69-9d26e28889dc', '6b283a76-03d2-497b-8790-e0533969cf84'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:12:33 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Delete snapshot completed successfully.
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f89c2ef-efff-4a1f-8ee0-a9a4059e6f33 tempest-VolumeDependencyTests-495732398 None] Lock "cinder-c345a321-6f0c-40a3-af46-c30a62b069f0-delete_snapshot" released by "delete_snapshot" :: held 4.787s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:33 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-50944ce5-3f8f-41d0-9096-e4e8abc54287" returned: 0 in 0.720s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.469s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd89f219-98bf-4e05-a1e4-888170f10076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50944ce5-3f8f-41d0-9096-e4e8abc54287', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04feddb-2eb2-4685-8184-1bb1b967c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] Creating offline snapshot b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8 of volume 398aa2d8-5146-4610-9dd1-35d7c638286e {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:12:33 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Volume volume-50944ce5-3f8f-41d0-9096-e4e8abc54287 (50944ce5-3f8f-41d0-9096-e4e8abc54287): created successfully
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e04feddb-2eb2-4685-8184-1bb1b967c70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Flow 'volume_create_manager' (15eb5f63-93d4-485d-961f-ae095caedba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c934f849-a886-4e3a-8b7c-1040fec79c52]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:33 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-146d258c-7248-452a-8c34-9dd1e653db22 tempest-ProjectReaderTests-186792488 None] Created volume successfully.
Jul 04 00:12:33 devstack sudo[105045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e
Jul 04 00:12:33 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Acquiring lock "cinder-50944ce5-3f8f-41d0-9096-e4e8abc54287-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Lock "cinder-50944ce5-3f8f-41d0-9096-e4e8abc54287-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Acquiring lock "cinder-quobyte-50944ce5-3f8f-41d0-9096-e4e8abc54287" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Lock "cinder-quobyte-50944ce5-3f8f-41d0-9096-e4e8abc54287" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[320574fb-7fc2-47b2-b8f7-098c1f9ff798]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-50944ce5-3f8f-41d0-9096-e4e8abc54287 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Acquiring lock "cinder-010e148a-a5c4-418c-a7a6-f0385ba4a48f-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Lock "cinder-010e148a-a5c4-418c-a7a6-f0385ba4a48f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Acquiring lock "cinder-quobyte-010e148a-a5c4-418c-a7a6-f0385ba4a48f" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Lock "cinder-quobyte-010e148a-a5c4-418c-a7a6-f0385ba4a48f" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:34 devstack sudo[105047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-50944ce5-3f8f-41d0-9096-e4e8abc54287
Jul 04 00:12:34 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5022ab0-00ef-4b36-8149-f33e28894867]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:34 devstack sudo[105049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f
Jul 04 00:12:34 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:34 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e" returned: 0 in 0.914s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:34 devstack sudo[105054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8 1G
Jul 04 00:12:34 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:35 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-50944ce5-3f8f-41d0-9096-e4e8abc54287" returned: 0 in 0.862s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-50944ce5-3f8f-41d0-9096-e4e8abc54287 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:35 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-50944ce5-3f8f-41d0-9096-e4e8abc54287
Jul 04 00:12:35 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:35 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f" returned: 0 in 0.841s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:35 devstack sudo[105066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f
Jul 04 00:12:35 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:35 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8 1G" returned: 0 in 0.943s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-398aa2d8-5146-4610-9dd1-35d7c638286e -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:35 devstack sudo[105070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-398aa2d8-5146-4610-9dd1-35d7c638286e -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8
Jul 04 00:12:35 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:35 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-50944ce5-3f8f-41d0-9096-e4e8abc54287" returned: 0 in 0.735s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Lock "cinder-quobyte-50944ce5-3f8f-41d0-9096-e4e8abc54287" released by "delete_volume" :: held 1.651s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Created reservations ['eab3eec5-46f4-4358-813e-155bb49f1036', '8029f092-5d3a-4e66-9b76-1b50f294765f', '4b0c103f-ca5e-4074-98dc-8e1858181db9', '773a2a6b-d9e8-4b7e-af84-13e54c423733'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:12:35 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-010e148a-a5c4-418c-a7a6-f0385ba4a48f" returned: 0 in 0.695s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Lock "cinder-quobyte-010e148a-a5c4-418c-a7a6-f0385ba4a48f" released by "delete_volume" :: held 1.598s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:35 devstack sudo[105074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:12:35 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Created reservations ['254f3421-0b6e-4f5b-a48a-67cb738d8b50', '0f2d3e6f-cf20-4e98-ab3f-d37016cd60ca', '4ed3ac37-79ad-466b-8b09-fa79e3a6ed97', 'ddbf40d9-4a9a-4b9f-b86b-e90819991f25'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:36 devstack sudo[105076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:12:36 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:36 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-398aa2d8-5146-4610-9dd1-35d7c638286e -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8" returned: 0 in 0.987s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:36 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8 is being set with open permissions: ugo+rw
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:36 devstack sudo[105082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8
Jul 04 00:12:36 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Acquiring lock "cinder-3437c705-3e60-4f28-ab8f-6ed11f370ad5-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Lock "cinder-3437c705-3e60-4f28-ab8f-6ed11f370ad5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Acquiring lock "cinder-quobyte-3437c705-3e60-4f28-ab8f-6ed11f370ad5" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Lock "cinder-quobyte-3437c705-3e60-4f28-ab8f-6ed11f370ad5" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6179600-a5dd-46d7-84ff-cbc56b110c79]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:36 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.871s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:12:36 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Deleted volume successfully.
Jul 04 00:12:36 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2724d232-04b6-494b-904f-4aa603e09299 tempest-ProjectReaderTests-186792488 None] Lock "cinder-50944ce5-3f8f-41d0-9096-e4e8abc54287-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:36 devstack sudo[105085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5
Jul 04 00:12:36 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:37 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.988s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:12:37 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Deleted volume successfully.
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-6e51c9ed-756f-4d87-ba7b-43f1003946ff tempest-VolumeDependencyTests-495732398 None] Lock "cinder-010e148a-a5c4-418c-a7a6-f0385ba4a48f-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Flow 'volume_create_manager' (ae7e3a06-ac7b-4bd8-b818-37f18fe0738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472b5afd-bbef-4e57-b6f9-b14d136c5f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472b5afd-bbef-4e57-b6f9-b14d136c5f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334354227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50c8147-98ee-42c3-a1f7-3783e08f33fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428202492bd04a078316f65d579e8ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:37Z,use_quota=True,user_id='55d2e28510054156b21fe713989f0776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e64fa4-abfa-4844-9d87-e6d83c5b2d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e64fa4-abfa-4844-9d87-e6d83c5b2d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b028340-9ba5-4f75-a288-c0c4125de500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b028340-9ba5-4f75-a288-c0c4125de500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e50c8147-98ee-42c3-a1f7-3783e08f33fa', 'volume_name': 'volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdc07bf-7669-4d6c-8e17-88603dc3bd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdc07bf-7669-4d6c-8e17-88603dc3bd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a68d66a-729d-4f86-aa63-c45639087ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:37 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Volume e50c8147-98ee-42c3-a1f7-3783e08f33fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa', 'volume_size': 1}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:37 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8" returned: 0 in 0.911s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:37 devstack sudo[105089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.info
Jul 04 00:12:37 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:37 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5" returned: 0 in 0.896s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:37 devstack sudo[105094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5
Jul 04 00:12:37 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:38 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.info" returned: 0 in 0.723s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:38 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.info is being set with open permissions: ugo+rw
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:38 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.info
Jul 04 00:12:38 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:38 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-3437c705-3e60-4f28-ab8f-6ed11f370ad5" returned: 0 in 0.650s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Lock "cinder-quobyte-3437c705-3e60-4f28-ab8f-6ed11f370ad5" released by "delete_volume" :: held 1.606s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Created reservations ['6b8df7f5-a0b1-4aff-94c1-57f680dd80f9', 'e1bf929f-da4b-4445-af6d-5f1a3faf36e3', '72fdf04d-9e66-4c3b-b0f0-50023a3e6c01', 'db6af175-7701-4788-afa0-92d49dfb8869'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:38 devstack sudo[105100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:12:38 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:38 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.info" returned: 0 in 0.747s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.344s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.219s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1215637133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6873d00c-e1ad-4c2e-8d20-30034685d524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fec01d9408c47f1af304b7927b3b841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:33Z,use_quota=True,user_id='8909de9402664743a46c3db75033e835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Creating volume 6873d00c-e1ad-4c2e-8d20-30034685d524 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:12:38 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:12:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:39 devstack sudo[105103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 1073741824
Jul 04 00:12:39 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-23e9569b-7121-4107-9e8f-076cb4cb15dd tempest-ProjectMemberTests-1651402342 None] Create snapshot completed successfully
Jul 04 00:12:39 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.676s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:12:39 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Deleted volume successfully.
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-88ce5bee-e734-4836-9c2f-347f314227cb tempest-VolumeDependencyTests-495732398 None] Lock "cinder-3437c705-3e60-4f28-ab8f-6ed11f370ad5-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-398aa2d8-5146-4610-9dd1-35d7c638286e" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-398aa2d8-5146-4610-9dd1-35d7c638286e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Deleting offline snapshot b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8 of volume 398aa2d8-5146-4610-9dd1-35d7c638286e {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] snapshot_file for this snap is: volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2eedd3-a262-4dd3-8474-a6143499a680]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:39 devstack sudo[105108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8
Jul 04 00:12:39 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:39 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 1073741824" returned: 0 in 0.985s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:40 devstack sudo[105112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524
Jul 04 00:12:40 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:40 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8" returned: 0 in 1.009s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-398aa2d8-5146-4610-9dd1-35d7c638286e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[087a7b50-9024-4148-b6c9-be54a49c8f8a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:40 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524" returned: 0 in 0.690s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.500s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334354227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e50c8147-98ee-42c3-a1f7-3783e08f33fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428202492bd04a078316f65d579e8ceb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:37Z,use_quota=True,user_id='55d2e28510054156b21fe713989f0776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Creating volume e50c8147-98ee-42c3-a1f7-3783e08f33fa {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:12:40 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259d04bb-7fd6-4c0e-afa8-ecc8c25c7ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6873d00c-e1ad-4c2e-8d20-30034685d524', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aeb63cf-8dd4-47c2-94a7-858de5f0a1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:40 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa 1073741824
Jul 04 00:12:40 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:40 devstack sudo[105118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e
Jul 04 00:12:40 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:40 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Volume volume-6873d00c-e1ad-4c2e-8d20-30034685d524 (6873d00c-e1ad-4c2e-8d20-30034685d524): created successfully
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aeb63cf-8dd4-47c2-94a7-858de5f0a1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Flow 'volume_create_manager' (718020ef-08a2-4c74-afa8-63fb8b5db4a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:40 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5c4a3865-37ee-4c0e-a532-8dda9896dc55 tempest-SnapshotDependencyTests-1805254304 None] Created volume successfully.
Jul 04 00:12:41 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e" returned: 0 in 0.840s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:41 devstack sudo[105130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8
Jul 04 00:12:41 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:41 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa 1073741824" returned: 0 in 1.048s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:41 devstack sudo[105133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa
Jul 04 00:12:41 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:42 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8" returned: 0 in 0.866s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:42 devstack sudo[105139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8
Jul 04 00:12:42 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:42 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa" returned: 0 in 0.761s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.025s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a68d66a-729d-4f86-aa63-c45639087ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0bbde4-b566-4d86-be79-466ab0eca8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] Creating offline snapshot b4a2644d-c641-43ae-854e-cd5c1b3fa493 of volume 6873d00c-e1ad-4c2e-8d20-30034685d524 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef19f485-3ff8-4c3a-b8c3-9353240026fd]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:42 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Volume volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa (e50c8147-98ee-42c3-a1f7-3783e08f33fa): created successfully
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea0bbde4-b566-4d86-be79-466ab0eca8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Flow 'volume_create_manager' (ae7e3a06-ac7b-4bd8-b818-37f18fe0738e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-fd4a8928-ff06-44c6-96c9-eaed44fdd987 tempest-ProjectReaderTests-186792488 None] Created volume successfully.
Jul 04 00:12:42 devstack sudo[105142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524
Jul 04 00:12:42 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:43 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e.b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8" returned: 0 in 0.807s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8" released by "_delete_snapshot" :: held 3.647s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-398aa2d8-5146-4610-9dd1-35d7c638286e" released by "delete_snapshot" :: held 3.677s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Created reservations ['d4cb2766-4a36-4d94-97cf-2436ca6d25ca', '3d9a3c7e-93cd-42c6-bcd1-27585809bfd0', 'da5c0940-2c51-4c16-8f4d-ff14d6e4903b', 'e0caa0f4-cb2b-4024-bef5-ccffef6b9e6c'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:12:43 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Delete snapshot completed successfully.
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-720ccc65-e2f3-409c-a4dc-0e26f9354047 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-b4ab1700-9a8f-4520-b4c1-7160dcf9a5f8-delete_snapshot" released by "delete_snapshot" :: held 3.831s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:43 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524" returned: 0 in 0.805s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:43 devstack sudo[105148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493 1G
Jul 04 00:12:43 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Acquiring lock "cinder-e50c8147-98ee-42c3-a1f7-3783e08f33fa-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Lock "cinder-e50c8147-98ee-42c3-a1f7-3783e08f33fa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Acquiring lock "cinder-quobyte-e50c8147-98ee-42c3-a1f7-3783e08f33fa" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Lock "cinder-quobyte-e50c8147-98ee-42c3-a1f7-3783e08f33fa" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d2e923-3b1f-4dd8-afd2-5e48bf60493b]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-398aa2d8-5146-4610-9dd1-35d7c638286e-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-398aa2d8-5146-4610-9dd1-35d7c638286e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-398aa2d8-5146-4610-9dd1-35d7c638286e" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-398aa2d8-5146-4610-9dd1-35d7c638286e" acquired by "delete_volume" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:44 devstack sudo[105150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa
Jul 04 00:12:44 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:44 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c714239b-5406-42d7-b38c-4a3f657c3166]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:44 devstack sudo[105152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e
Jul 04 00:12:44 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:44 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493 1G" returned: 0 in 1.189s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6873d00c-e1ad-4c2e-8d20-30034685d524 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:44 devstack sudo[105159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6873d00c-e1ad-4c2e-8d20-30034685d524 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493
Jul 04 00:12:44 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:44 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa" returned: 0 in 0.957s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:44 devstack sudo[105163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa
Jul 04 00:12:44 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:45 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e" returned: 0 in 1.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:45 devstack sudo[105168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e
Jul 04 00:12:45 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:45 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6873d00c-e1ad-4c2e-8d20-30034685d524 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493" returned: 0 in 1.072s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:45 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493 is being set with open permissions: ugo+rw
Jul 04 00:12:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:45 devstack sudo[105176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493
Jul 04 00:12:45 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:45 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e50c8147-98ee-42c3-a1f7-3783e08f33fa" returned: 0 in 0.962s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Lock "cinder-quobyte-e50c8147-98ee-42c3-a1f7-3783e08f33fa" released by "delete_volume" :: held 1.988s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:45 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Created reservations ['c481cf8d-b3e6-48dc-9e5f-2893f926699c', '069f4d6f-de94-44c6-8c72-439f6ee339ba', '34bc881f-993a-4bbe-a244-659696396b57', '5207b72d-0343-463a-9ff7-062801845859'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:12:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:45 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:46 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-398aa2d8-5146-4610-9dd1-35d7c638286e" returned: 0 in 0.955s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:46 devstack sudo[105179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:12:46 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-398aa2d8-5146-4610-9dd1-35d7c638286e" released by "delete_volume" :: held 2.081s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Created reservations ['e53986a0-ea1e-4538-8908-b5f1c889ea82', 'a44a9e18-7126-42a4-bab1-099b94f7b9f5', 'a6031972-b535-47df-b79d-919fefdba6ea', 'c20e0295-efe0-4327-9422-450ad7dc5fae'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:46 devstack sudo[105182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:12:46 devstack sudo[105182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:46 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493" returned: 0 in 1.186s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:46 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.966s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:46 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:12:46 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Deleted volume successfully.
Jul 04 00:12:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:47 devstack sudo[105186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.info
Jul 04 00:12:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-f08838d8-caea-4fcc-b09e-f39420a51daa tempest-ProjectReaderTests-186792488 None] Lock "cinder-e50c8147-98ee-42c3-a1f7-3783e08f33fa-delete_volume" released by "delete_volume" :: held 3.362s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:47 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:47 devstack sudo[105182]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.906s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:47 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:12:47 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Deleted volume successfully.
Jul 04 00:12:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e59d8e74-dde0-403e-91e5-09c47fd51798 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-398aa2d8-5146-4610-9dd1-35d7c638286e-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:47 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.info" returned: 0 in 0.944s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:47 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.info is being set with open permissions: ugo+rw
Jul 04 00:12:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:47 devstack sudo[105190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.info
Jul 04 00:12:47 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (90c760d7-ca76-4efd-a833-f4b35b2cf1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b5de59-dc79-4077-99d6-cb83a19d7c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b5de59-dc79-4077-99d6-cb83a19d7c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182311851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe9aba3-d6d9-4260-b1a5-751b53bf5262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:48Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc9d0df-65b7-456f-8b17-d324f8df24d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc9d0df-65b7-456f-8b17-d324f8df24d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe908dda-5ee5-4c2f-8e29-052af04f8346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe908dda-5ee5-4c2f-8e29-052af04f8346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe9aba3-d6d9-4260-b1a5-751b53bf5262', 'volume_name': 'volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a298ba83-f4d9-44c7-baf7-f937e7a4a67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a298ba83-f4d9-44c7-baf7-f937e7a4a67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc113f2-5757-412c-a4ae-09d93392d51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:48 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Volume 5fe9aba3-d6d9-4260-b1a5-751b53bf5262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262', 'volume_size': 1}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:48 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.info" returned: 0 in 0.769s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.167s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.629s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182311851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe9aba3-d6d9-4260-b1a5-751b53bf5262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:48Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Creating volume 5fe9aba3-d6d9-4260-b1a5-751b53bf5262 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:12:48 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:12:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:48 devstack sudo[105193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262 1073741824
Jul 04 00:12:48 devstack sudo[105193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:48 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a06fd3aa-f679-4225-87cf-bd7021023b42 tempest-SnapshotDependencyTests-1805254304 None] Create snapshot completed successfully
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Flow 'volume_create_manager' (1445fed7-356f-45b6-b3f6-3e54e9e805f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712f0ed0-2945-4693-9bab-58893dee0b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712f0ed0-2945-4693-9bab-58893dee0b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297447636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318deaa5-c86c-4429-9c85-665ee38d1131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043ab7c2bf5c4bd1b7bce510ae92f54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:49Z,use_quota=True,user_id='834d3fa91ba04d969e15a3a9ab7587e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91a9a83-7bef-4244-9e98-23c6c4de8c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91a9a83-7bef-4244-9e98-23c6c4de8c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8307e4b6-1051-4e32-a35f-61f2df7e381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8307e4b6-1051-4e32-a35f-61f2df7e381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318deaa5-c86c-4429-9c85-665ee38d1131', 'volume_name': 'volume-318deaa5-c86c-4429-9c85-665ee38d1131', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6a2d03-3dce-4c1b-93ec-50bedbd4ecef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6a2d03-3dce-4c1b-93ec-50bedbd4ecef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c35d5ab0-95db-417b-9f90-1aa1ee95ec27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:49 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Volume 318deaa5-c86c-4429-9c85-665ee38d1131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318deaa5-c86c-4429-9c85-665ee38d1131', 'volume_size': 1}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Flow 'volume_create_manager' (5f66e069-9c80-41ee-ad44-3f722ce17307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf544b52-f487-4e60-ad2c-1fa29e256403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf544b52-f487-4e60-ad2c-1fa29e256403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe7e341-158a-431e-a6af-4e22ceb4fffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fec01d9408c47f1af304b7927b3b841',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b4a2644d-c641-43ae-854e-cd5c1b3fa493,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:50Z,use_quota=True,user_id='8909de9402664743a46c3db75033e835',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0202b0-8c52-4336-98d5-02ca5039f70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0202b0-8c52-4336-98d5-02ca5039f70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cd25eb-a458-4ed1-9007-0878d5a475c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:49 devstack sudo[105193]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1cd25eb-a458-4ed1-9007-0878d5a475c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2fe7e341-158a-431e-a6af-4e22ceb4fffa', 'volume_name': 'volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa', 'volume_size': 1, 'snapshot_id': 'b4a2644d-c641-43ae-854e-cd5c1b3fa493'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a153922a-e0fb-4862-82d0-2d82dcd1fac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a153922a-e0fb-4862-82d0-2d82dcd1fac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d277393-6cee-48fe-a932-4a52883a3e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:49 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Volume 2fe7e341-158a-431e-a6af-4e22ceb4fffa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa', 'volume_size': 1, 'snapshot_id': 'b4a2644d-c641-43ae-854e-cd5c1b3fa493'}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262 1073741824" returned: 0 in 1.033s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:49 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262
Jul 04 00:12:49 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:50 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262" returned: 0 in 0.662s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297447636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318deaa5-c86c-4429-9c85-665ee38d1131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043ab7c2bf5c4bd1b7bce510ae92f54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:49Z,use_quota=True,user_id='834d3fa91ba04d969e15a3a9ab7587e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Creating volume 318deaa5-c86c-4429-9c85-665ee38d1131 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:12:50 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:50 devstack sudo[105202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131 1073741824
Jul 04 00:12:50 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbc113f2-5757-412c-a4ae-09d93392d51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8f3129-2d89-4df3-99c8-491ff9bf215e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:50 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Volume volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262 (5fe9aba3-d6d9-4260-b1a5-751b53bf5262): created successfully
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8f3129-2d89-4df3-99c8-491ff9bf215e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (90c760d7-ca76-4efd-a833-f4b35b2cf1f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:50 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-6595dfd1-73d9-4f05-a6f2-457ebb4eb57f tempest-ProjectMemberTests-1651402342 None] Created volume successfully.
Jul 04 00:12:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:51 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131 1073741824" returned: 0 in 1.021s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:51 devstack sudo[105208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131
Jul 04 00:12:51 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:52 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131" returned: 0 in 0.641s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.400s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "cinder-quobyte-b4a2644d-c641-43ae-854e-cd5c1b3fa493-2fe7e341-158a-431e-a6af-4e22ceb4fffa" by "_create_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c35d5ab0-95db-417b-9f90-1aa1ee95ec27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318deaa5-c86c-4429-9c85-665ee38d1131', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b804cca1-48f4-42bf-ad5e-e09b662797ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-quobyte-b4a2644d-c641-43ae-854e-cd5c1b3fa493-2fe7e341-158a-431e-a6af-4e22ceb4fffa" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Creating volume 2fe7e341-158a-431e-a6af-4e22ceb4fffa from snapshot b4a2644d-c641-43ae-854e-cd5c1b3fa493 {{(pid=86648) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "cinder-quobyte-2fe7e341-158a-431e-a6af-4e22ceb4fffa" by "_copy_volume_from_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:52 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Volume volume-318deaa5-c86c-4429-9c85-665ee38d1131 (318deaa5-c86c-4429-9c85-665ee38d1131): created successfully
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b804cca1-48f4-42bf-ad5e-e09b662797ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Flow 'volume_create_manager' (1445fed7-356f-45b6-b3f6-3e54e9e805f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-quobyte-2fe7e341-158a-431e-a6af-4e22ceb4fffa" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] snapshot: b4a2644d-c641-43ae-854e-cd5c1b3fa493, volume: 2fe7e341-158a-431e-a6af-4e22ceb4fffa,  {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:12:52 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4955fa67-dd22-4341-aedb-e28311a0fc7e tempest-ProjectReaderTests-762732484 None] Created volume successfully.
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a767fc0c-4aad-4267-9b6b-19f18f39cf46]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:52 devstack sudo[105211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493
Jul 04 00:12:52 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:53 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493" returned: 0 in 0.771s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6873d00c-e1ad-4c2e-8d20-30034685d524(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:12:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:12:53 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Creating direct copy from snapshot {{(pid=86648) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:12:53 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1391048-f400-4d42-a3cd-dd2f062c2aa2]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:53 devstack sudo[105216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524
Jul 04 00:12:53 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:53 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524" returned: 0 in 0.796s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:53 devstack cinder-volume[86648]: DEBUG cinder.utils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Path /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa not found in is_blk_device check {{(pid=86648) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:12:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:53 devstack sudo[105221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa
Jul 04 00:12:53 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:58 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa" returned: 0 in 4.325s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[940d9015-7a50-435d-8c32-522c4f6e272a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:58 devstack sudo[105234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524
Jul 04 00:12:58 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:59 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524" returned: 0 in 0.881s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG cinder.image.image_utils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Image conversion details: src /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa {{(pid=86648) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:12:59 devstack cinder-volume[86648]: INFO cinder.image.image_utils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Converted 1024.00 MB image at 236.69 MB/s
Jul 04 00:12:59 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa is being set with open permissions: ugo+rw
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:59 devstack sudo[105239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa
Jul 04 00:12:59 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:59 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa" returned: 0 in 0.647s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-quobyte-2fe7e341-158a-431e-a6af-4e22ceb4fffa" released by "_copy_volume_from_snapshot" :: held 7.527s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-quobyte-b4a2644d-c641-43ae-854e-cd5c1b3fa493-2fe7e341-158a-431e-a6af-4e22ceb4fffa" released by "_create_volume_from_snapshot" :: held 7.574s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.612s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.428s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] Creating offline snapshot a48fcace-d3fd-4513-924c-dc77bb011591 of volume 5fe9aba3-d6d9-4260-b1a5-751b53bf5262 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d277393-6cee-48fe-a932-4a52883a3e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa', 'volume_size': 1, 'snapshot_id': 'b4a2644d-c641-43ae-854e-cd5c1b3fa493'}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434074f9-d512-43e1-bc3c-e57a00f69264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7a3e1f-6e16-43d8-8f51-a556b885c4e0]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:59 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Volume volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa (2fe7e341-158a-431e-a6af-4e22ceb4fffa): created successfully
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434074f9-d512-43e1-bc3c-e57a00f69264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:59 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Flow 'volume_create_manager' (5f66e069-9c80-41ee-ad44-3f722ce17307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:59 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8172a6a0-abfa-4404-9967-bb9370a11520 tempest-SnapshotDependencyTests-1805254304 None] Created volume successfully.
Jul 04 00:12:59 devstack sudo[105242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262
Jul 04 00:12:59 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "cinder-b4a2644d-c641-43ae-854e-cd5c1b3fa493-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-b4a2644d-c641-43ae-854e-cd5c1b3fa493-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "cinder-quobyte-6873d00c-e1ad-4c2e-8d20-30034685d524" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-quobyte-6873d00c-e1ad-4c2e-8d20-30034685d524" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "cinder-quobyte-b4a2644d-c641-43ae-854e-cd5c1b3fa493" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-quobyte-b4a2644d-c641-43ae-854e-cd5c1b3fa493" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Deleting offline snapshot b4a2644d-c641-43ae-854e-cd5c1b3fa493 of volume 6873d00c-e1ad-4c2e-8d20-30034685d524 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:13:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] snapshot_file for this snap is: volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:13:00 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262" returned: 0 in 0.771s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:00 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8945a9ed-229e-4349-8c15-74658bb3533f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:00 devstack sudo[105247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591 1G
Jul 04 00:13:00 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:00 devstack sudo[105248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493
Jul 04 00:13:00 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:01 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493" returned: 0 in 0.786s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:01 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6873d00c-e1ad-4c2e-8d20-30034685d524(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:13:01 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591 1G" returned: 0 in 0.814s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:01 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a22859-2fc5-4210-b4ff-a5ec6f155593]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:01 devstack sudo[105258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591
Jul 04 00:13:01 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:01 devstack sudo[105259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524
Jul 04 00:13:01 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:02 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591" returned: 0 in 0.689s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:02 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591 is being set with open permissions: ugo+rw
Jul 04 00:13:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:02 devstack sudo[105265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591
Jul 04 00:13:02 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:02 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524" returned: 0 in 0.851s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:02 devstack sudo[105271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493
Jul 04 00:13:02 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:02 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591" returned: 0 in 0.660s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:02 devstack sudo[105274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.info
Jul 04 00:13:02 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:03 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493" returned: 0 in 0.792s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:03 devstack sudo[105280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493
Jul 04 00:13:03 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:03 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.info" returned: 0 in 0.700s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:03 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.info is being set with open permissions: ugo+rw
Jul 04 00:13:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:03 devstack sudo[105283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.info
Jul 04 00:13:03 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:03 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524.b4a2644d-c641-43ae-854e-cd5c1b3fa493" returned: 0 in 0.741s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-quobyte-b4a2644d-c641-43ae-854e-cd5c1b3fa493" released by "_delete_snapshot" :: held 3.288s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:03 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-quobyte-6873d00c-e1ad-4c2e-8d20-30034685d524" released by "delete_snapshot" :: held 3.312s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:03 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Created reservations ['f92cf8ee-3c1d-46ef-99ad-64403b2fb3bf', '10ea0602-3717-4b83-a13d-b74a6f15b998', '954cf659-989f-4f1a-b05c-8dff1370e092', 'e3d01ee1-2513-4ff0-93f1-f0421148099e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:04 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Delete snapshot completed successfully.
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-dbedf2fd-76a1-4d70-aaaf-f63ba577825f tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-b4a2644d-c641-43ae-854e-cd5c1b3fa493-delete_snapshot" released by "delete_snapshot" :: held 3.462s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:04 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.info" returned: 0 in 0.719s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.453s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.678s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] Creating offline snapshot ea835ac9-e07a-4968-b8b6-a54bf6e88f7b of volume 318deaa5-c86c-4429-9c85-665ee38d1131 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:13:04 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e3255f72-ebf7-477b-9926-8954f47e504b tempest-ProjectMemberTests-1651402342 None] Create snapshot completed successfully
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b06cd7-b77c-4882-a811-ec3c56e858ab]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:04 devstack sudo[105287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131
Jul 04 00:13:04 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "cinder-6873d00c-e1ad-4c2e-8d20-30034685d524-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-6873d00c-e1ad-4c2e-8d20-30034685d524-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "cinder-quobyte-6873d00c-e1ad-4c2e-8d20-30034685d524" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-quobyte-6873d00c-e1ad-4c2e-8d20-30034685d524" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e2706a-55dd-4be4-900a-470b1aa0c6ac]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-a48fcace-d3fd-4513-924c-dc77bb011591-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Lock "cinder-a48fcace-d3fd-4513-924c-dc77bb011591-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:04 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-5fe9aba3-d6d9-4260-b1a5-751b53bf5262" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-5fe9aba3-d6d9-4260-b1a5-751b53bf5262" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-a48fcace-d3fd-4513-924c-dc77bb011591" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-a48fcace-d3fd-4513-924c-dc77bb011591" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Deleting offline snapshot a48fcace-d3fd-4513-924c-dc77bb011591 of volume 5fe9aba3-d6d9-4260-b1a5-751b53bf5262 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] snapshot_file for this snap is: volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e11d8e-2b42-4d13-a9f9-8c4d4300046f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:05 devstack sudo[105289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524
Jul 04 00:13:05 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:05 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131" returned: 0 in 0.839s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:05 devstack sudo[105293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591
Jul 04 00:13:05 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b 1G
Jul 04 00:13:05 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:05 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:05 devstack sudo[105298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:13:05 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:05 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.701s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:13:05 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591" returned: 0 in 0.844s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:13:05 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524" returned: 0 in 0.999s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe75853-8b34-494c-b2ad-c56cda2518e7]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:05 devstack sudo[105314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524
Jul 04 00:13:05 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:06 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b 1G" returned: 0 in 0.898s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318deaa5-c86c-4429-9c85-665ee38d1131 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:06 devstack sudo[105317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318deaa5-c86c-4429-9c85-665ee38d1131 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b
Jul 04 00:13:06 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:06 devstack sudo[105315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262
Jul 04 00:13:06 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:06 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-6873d00c-e1ad-4c2e-8d20-30034685d524" returned: 0 in 0.798s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:06 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-quobyte-6873d00c-e1ad-4c2e-8d20-30034685d524" released by "delete_volume" :: held 1.882s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262" returned: 0 in 0.822s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:06 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318deaa5-c86c-4429-9c85-665ee38d1131 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b" returned: 0 in 0.741s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:06 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b is being set with open permissions: ugo+rw
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:06 devstack sudo[105328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591
Jul 04 00:13:06 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:06 devstack sudo[105329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b
Jul 04 00:13:06 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Created reservations ['5ddf7414-fc7d-413e-8ac8-53219dba032d', '5b6f1a6b-6ed7-4e6a-b0a6-6b73e7ef14da', '549f3a62-578f-4d02-a945-b9e5b7b97dfb', '2ba8624b-57e6-40dd-a595-916754ed3210'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:07 devstack sudo[105332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:13:07 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "cinder-2fe7e341-158a-431e-a6af-4e22ceb4fffa-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-2fe7e341-158a-431e-a6af-4e22ceb4fffa-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "cinder-quobyte-2fe7e341-158a-431e-a6af-4e22ceb4fffa" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-quobyte-2fe7e341-158a-431e-a6af-4e22ceb4fffa" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f474d03-2f14-4a0a-aaf2-1d0b4a5c80ae]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:07 devstack sudo[105334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa
Jul 04 00:13:07 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:07 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b" returned: 0 in 0.736s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:07 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:07 devstack sudo[105341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.info
Jul 04 00:13:07 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591" returned: 0 in 0.815s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:07 devstack sudo[105343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591
Jul 04 00:13:07 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:07 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.899s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:13:07 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Deleted volume successfully.
Jul 04 00:13:07 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a49a3a07-31dc-48e0-9ef9-ee2850093afb tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-6873d00c-e1ad-4c2e-8d20-30034685d524-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:08 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa" returned: 0 in 0.878s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:08 devstack sudo[105351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa
Jul 04 00:13:08 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:08 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.info" returned: 0 in 0.715s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:08 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.info is being set with open permissions: ugo+rw
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:08 devstack sudo[105353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.info
Jul 04 00:13:08 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:08 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262.a48fcace-d3fd-4513-924c-dc77bb011591" returned: 0 in 0.736s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-a48fcace-d3fd-4513-924c-dc77bb011591" released by "_delete_snapshot" :: held 3.361s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-5fe9aba3-d6d9-4260-b1a5-751b53bf5262" released by "delete_snapshot" :: held 3.385s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Created reservations ['33f02f75-e873-4bd5-9e7b-e632b6c6cf6c', '141a1b85-85a8-41c7-8498-82097cfe1161', '07c9a8b4-6eae-42b6-8864-1b93141c4bd5', '6de153e4-cc8b-435d-939b-5de9109acede'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:08 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Delete snapshot completed successfully.
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f4dc873-66ff-44ff-b2d8-a9c56fc7310b tempest-ProjectMemberTests-1651402342 None] Lock "cinder-a48fcace-d3fd-4513-924c-dc77bb011591-delete_snapshot" released by "delete_snapshot" :: held 3.536s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:08 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.info" returned: 0 in 0.650s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:08 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.678s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2fe7e341-158a-431e-a6af-4e22ceb4fffa" returned: 0 in 0.746s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:08 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-quobyte-2fe7e341-158a-431e-a6af-4e22ceb4fffa" released by "delete_volume" :: held 1.680s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:08 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-94868076-21fb-4493-82f3-39c09ba89b82 tempest-ProjectReaderTests-762732484 None] Create snapshot completed successfully
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Created reservations ['7e60744c-6215-4492-88bf-b5fb4f70f24c', '2b1eae7a-1874-44ea-95bf-88db5dc26a93', 'be99618c-a319-4a18-bb86-3b43de94215e', '50c93083-34a4-46e6-88ae-7fc36b2f53a4'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:09 devstack sudo[105357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:13:09 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-5fe9aba3-d6d9-4260-b1a5-751b53bf5262-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-5fe9aba3-d6d9-4260-b1a5-751b53bf5262-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-5fe9aba3-d6d9-4260-b1a5-751b53bf5262" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-5fe9aba3-d6d9-4260-b1a5-751b53bf5262" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[118d4742-de96-43cd-aa82-30aa3d48057a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:09 devstack sudo[105359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262
Jul 04 00:13:09 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-ea835ac9-e07a-4968-b8b6-a54bf6e88f7b-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Lock "cinder-ea835ac9-e07a-4968-b8b6-a54bf6e88f7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-318deaa5-c86c-4429-9c85-665ee38d1131" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-318deaa5-c86c-4429-9c85-665ee38d1131" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-ea835ac9-e07a-4968-b8b6-a54bf6e88f7b" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-ea835ac9-e07a-4968-b8b6-a54bf6e88f7b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Deleting offline snapshot ea835ac9-e07a-4968-b8b6-a54bf6e88f7b of volume 318deaa5-c86c-4429-9c85-665ee38d1131 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] snapshot_file for this snap is: volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9c5a19-e7c9-498c-a7f9-68aa185f0ec8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:09 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.822s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:13:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Deleted volume successfully.
Jul 04 00:13:09 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b
Jul 04 00:13:09 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-87b1514c-fad3-4a70-bd33-48b048e66c27 tempest-SnapshotDependencyTests-1805254304 None] Lock "cinder-2fe7e341-158a-431e-a6af-4e22ceb4fffa-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:10 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262" returned: 0 in 0.935s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:10 devstack sudo[105367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262
Jul 04 00:13:10 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:10 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b" returned: 0 in 0.879s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:10 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-318deaa5-c86c-4429-9c85-665ee38d1131(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:13:10 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[de05b54c-5456-41d9-b3f8-aee69a43b9b2]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:10 devstack sudo[105372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131
Jul 04 00:13:10 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:11 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5fe9aba3-d6d9-4260-b1a5-751b53bf5262" returned: 0 in 0.791s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-5fe9aba3-d6d9-4260-b1a5-751b53bf5262" released by "delete_volume" :: held 1.831s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:11 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Created reservations ['66ef1fe5-cb67-4f9e-b9df-3c2ac2b550cf', 'c00acefb-c0d4-4ad4-bba8-e4fc5ccdd432', '0d99cceb-57ab-4872-a1bf-5ca3a71d00f1', '57de47a5-982b-44a5-b745-b82132ac3d4b'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:11 devstack sudo[105377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:13:11 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:11 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131" returned: 0 in 0.886s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:11 devstack sudo[105382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b
Jul 04 00:13:11 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:12 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.784s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:13:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Deleted volume successfully.
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (cdf197e9-64ac-48a0-a400-4de979c9e575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d8d1b6-d235-4ec3-8b3c-e8564c03d721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-e9ca1e8f-9adf-486b-b287-ba832a9b4067 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-5fe9aba3-d6d9-4260-b1a5-751b53bf5262-delete_volume" released by "delete_volume" :: held 2.939s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d8d1b6-d235-4ec3-8b3c-e8564c03d721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003051628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7c1db1-f274-404b-9f1b-3f2aeddf6787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:12Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ebb3b9-c09a-4052-9026-4614f7bed349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ebb3b9-c09a-4052-9026-4614f7bed349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0e22bd-fe0f-4497-be58-52f9d0098bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0e22bd-fe0f-4497-be58-52f9d0098bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e7c1db1-f274-404b-9f1b-3f2aeddf6787', 'volume_name': 'volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc405ed-4a66-4120-9ead-9a2577b64929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc405ed-4a66-4120-9ead-9a2577b64929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41573811-2cae-4a3a-9c4f-0f7fd1f795b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:12 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Volume 5e7c1db1-f274-404b-9f1b-3f2aeddf6787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787', 'volume_size': 1}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1003051628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7c1db1-f274-404b-9f1b-3f2aeddf6787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:12Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Creating volume 5e7c1db1-f274-404b-9f1b-3f2aeddf6787 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:13:12 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:12 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787 1073741824
Jul 04 00:13:12 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:12 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b" returned: 0 in 0.951s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:12 devstack sudo[105390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b
Jul 04 00:13:12 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:13 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787 1073741824" returned: 0 in 1.015s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:13 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131.ea835ac9-e07a-4968-b8b6-a54bf6e88f7b" returned: 0 in 0.824s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-ea835ac9-e07a-4968-b8b6-a54bf6e88f7b" released by "_delete_snapshot" :: held 3.649s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-318deaa5-c86c-4429-9c85-665ee38d1131" released by "delete_snapshot" :: held 3.680s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:13 devstack sudo[105397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787
Jul 04 00:13:13 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:13 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Created reservations ['906a1ad2-cc46-4bce-a102-e421e09e5c8c', '2183121b-5857-448b-8443-0d174a35d6c5', '60d8163a-517b-4cf6-9f8d-8c6f82c0cf34', 'b7ef7ffa-1deb-4162-a2ca-e34863dff4fc'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Delete snapshot completed successfully.
Jul 04 00:13:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0acaa250-0a24-4738-b484-28147600b25b tempest-ProjectReaderTests-762732484 None] Lock "cinder-ea835ac9-e07a-4968-b8b6-a54bf6e88f7b-delete_snapshot" released by "delete_snapshot" :: held 3.871s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-318deaa5-c86c-4429-9c85-665ee38d1131-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Lock "cinder-318deaa5-c86c-4429-9c85-665ee38d1131-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-318deaa5-c86c-4429-9c85-665ee38d1131" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-318deaa5-c86c-4429-9c85-665ee38d1131" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6f5f39-bd01-484e-bf26-6756cb1ee35b]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:14 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787" returned: 0 in 0.804s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:14 devstack sudo[105401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131
Jul 04 00:13:14 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41573811-2cae-4a3a-9c4f-0f7fd1f795b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46187269-193b-4896-8467-6ecf63474947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:14 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Volume volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787 (5e7c1db1-f274-404b-9f1b-3f2aeddf6787): created successfully
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46187269-193b-4896-8467-6ecf63474947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (cdf197e9-64ac-48a0-a400-4de979c9e575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:13:14 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-134203ab-5470-4dfb-a4e8-78978646d945 tempest-ProjectMemberTests-1651402342 None] Created volume successfully.
Jul 04 00:13:14 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131" returned: 0 in 0.793s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:14 devstack sudo[105406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131
Jul 04 00:13:14 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:15 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-318deaa5-c86c-4429-9c85-665ee38d1131" returned: 0 in 0.705s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] Creating offline snapshot 45a6f870-c17a-4add-acdf-2292497c3b21 of volume 5e7c1db1-f274-404b-9f1b-3f2aeddf6787 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[276f1b29-9d86-40de-84ed-46c96001e6a0]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-318deaa5-c86c-4429-9c85-665ee38d1131" released by "delete_volume" :: held 1.585s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Created reservations ['487a5c55-6358-4633-b6bf-bdfec7360fce', '0dbc3a60-8050-4163-9abf-9b81580acd30', '1bc94e94-e1bb-487d-99a2-b881bca0ac3a', 'e86c94ff-f403-4e86-a3dc-cd67c140a232'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:15 devstack sudo[105410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787
Jul 04 00:13:15 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:15 devstack sudo[105412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:13:15 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:16 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.780s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:16 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:13:16 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Deleted volume successfully.
Jul 04 00:13:16 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787" returned: 0 in 0.942s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-15470c38-e8a5-489b-9056-48adf79ff7d4 tempest-ProjectReaderTests-762732484 None] Lock "cinder-318deaa5-c86c-4429-9c85-665ee38d1131-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:16 devstack sudo[105418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21 1G
Jul 04 00:13:16 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:16 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Flow 'volume_create_manager' (ce9b6fd5-c9ee-4faa-8ddd-21020b8545a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00a3aa7-b709-4b6f-8b04-7f29cc35be98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00a3aa7-b709-4b6f-8b04-7f29cc35be98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-273020269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861720f9-07e8-4087-bd68-c395e26ab778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043ab7c2bf5c4bd1b7bce510ae92f54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:17Z,use_quota=True,user_id='834d3fa91ba04d969e15a3a9ab7587e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81f4ffb-c22e-4015-9afd-0fa651ad9a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b81f4ffb-c22e-4015-9afd-0fa651ad9a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fe2b95-4096-4e7b-8bd7-b555e5ad48c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fe2b95-4096-4e7b-8bd7-b555e5ad48c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '861720f9-07e8-4087-bd68-c395e26ab778', 'volume_name': 'volume-861720f9-07e8-4087-bd68-c395e26ab778', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b012b68d-7296-4eed-b6fa-cc136733a585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b012b68d-7296-4eed-b6fa-cc136733a585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9d6e3c-1ea2-4be6-8606-be8e44cf67c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:17 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Volume 861720f9-07e8-4087-bd68-c395e26ab778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-861720f9-07e8-4087-bd68-c395e26ab778', 'volume_size': 1}
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:17 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21 1G" returned: 0 in 0.996s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:17 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21
Jul 04 00:13:17 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:18 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21" returned: 0 in 0.746s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:18 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21 is being set with open permissions: ugo+rw
Jul 04 00:13:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:18 devstack sudo[105430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21
Jul 04 00:13:18 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:19 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21" returned: 0 in 0.766s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:19 devstack sudo[105469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.info
Jul 04 00:13:19 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:19 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.info" returned: 0 in 0.697s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:19 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.info is being set with open permissions: ugo+rw
Jul 04 00:13:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:19 devstack sudo[105472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.info
Jul 04 00:13:19 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:20 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.info" returned: 0 in 0.618s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.860s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.407s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-273020269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861720f9-07e8-4087-bd68-c395e26ab778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043ab7c2bf5c4bd1b7bce510ae92f54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:17Z,use_quota=True,user_id='834d3fa91ba04d969e15a3a9ab7587e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Creating volume 861720f9-07e8-4087-bd68-c395e26ab778 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:13:20 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:20 devstack sudo[105475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778 1073741824
Jul 04 00:13:20 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:20 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1033bef8-bfbe-4ae5-87f8-b319dfb65a84 tempest-ProjectMemberTests-1651402342 None] Create snapshot completed successfully
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-45a6f870-c17a-4add-acdf-2292497c3b21-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Lock "cinder-45a6f870-c17a-4add-acdf-2292497c3b21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-5e7c1db1-f274-404b-9f1b-3f2aeddf6787" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-5e7c1db1-f274-404b-9f1b-3f2aeddf6787" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-45a6f870-c17a-4add-acdf-2292497c3b21" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-45a6f870-c17a-4add-acdf-2292497c3b21" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Deleting offline snapshot 45a6f870-c17a-4add-acdf-2292497c3b21 of volume 5e7c1db1-f274-404b-9f1b-3f2aeddf6787 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:13:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] snapshot_file for this snap is: volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:13:21 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a686bf1-f351-4a3f-a86e-927fb18da9b8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:21 devstack sudo[105478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21
Jul 04 00:13:21 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:21 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778 1073741824" returned: 0 in 0.801s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:21 devstack sudo[105483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778
Jul 04 00:13:21 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:21 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21" returned: 0 in 0.844s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:13:21 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e639ccc5-1d67-4fa7-b812-e25f52b789af]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:21 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778" returned: 0 in 0.644s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:13:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:21 devstack sudo[105489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787
Jul 04 00:13:22 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9d6e3c-1ea2-4be6-8606-be8e44cf67c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861720f9-07e8-4087-bd68-c395e26ab778', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1f7670-0045-4fd8-a08c-c151ce27fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:22 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Volume volume-861720f9-07e8-4087-bd68-c395e26ab778 (861720f9-07e8-4087-bd68-c395e26ab778): created successfully
Jul 04 00:13:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1f7670-0045-4fd8-a08c-c151ce27fe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Flow 'volume_create_manager' (ce9b6fd5-c9ee-4faa-8ddd-21020b8545a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:13:22 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4c47f4f7-ea50-493b-a2d7-11a7803406b5 tempest-ProjectReaderTests-762732484 None] Created volume successfully.
Jul 04 00:13:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] Creating offline snapshot f0f3ab0e-3937-4621-ba0c-47e837640a0b of volume 861720f9-07e8-4087-bd68-c395e26ab778 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:13:22 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6336f514-9906-48ca-9b20-3bc18aa1c06b]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:22 devstack sudo[105491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778
Jul 04 00:13:22 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:22 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787" returned: 0 in 0.800s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:22 devstack sudo[105496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21
Jul 04 00:13:22 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:23 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778" returned: 0 in 0.799s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:23 devstack sudo[105504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b 1G
Jul 04 00:13:23 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:23 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21" returned: 0 in 0.752s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:23 devstack sudo[105506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21
Jul 04 00:13:23 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:24 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b 1G" returned: 0 in 0.790s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861720f9-07e8-4087-bd68-c395e26ab778 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:24 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787.45a6f870-c17a-4add-acdf-2292497c3b21" returned: 0 in 0.681s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:24 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861720f9-07e8-4087-bd68-c395e26ab778 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b
Jul 04 00:13:24 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-45a6f870-c17a-4add-acdf-2292497c3b21" released by "_delete_snapshot" :: held 3.180s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-5e7c1db1-f274-404b-9f1b-3f2aeddf6787" released by "delete_snapshot" :: held 3.202s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:24 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Created reservations ['2e5e9af6-9543-4069-9a94-6b4afefb5ecd', '0f457676-ee49-4b9c-9bf1-9b060317f48f', '8f4e19e6-6181-4092-a2f6-8add571e9e09', '6dd52de9-5c39-428b-86ec-2527fc614016'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:24 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Delete snapshot completed successfully.
Jul 04 00:13:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-21abef67-0148-4631-ad1d-22eeee8ac4ee tempest-ProjectMemberTests-1651402342 None] Lock "cinder-45a6f870-c17a-4add-acdf-2292497c3b21-delete_snapshot" released by "delete_snapshot" :: held 3.367s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:24 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-861720f9-07e8-4087-bd68-c395e26ab778 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b" returned: 0 in 0.719s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:24 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b is being set with open permissions: ugo+rw
Jul 04 00:13:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:24 devstack sudo[105518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b
Jul 04 00:13:24 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-5e7c1db1-f274-404b-9f1b-3f2aeddf6787-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-5e7c1db1-f274-404b-9f1b-3f2aeddf6787-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-5e7c1db1-f274-404b-9f1b-3f2aeddf6787" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:25 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-5e7c1db1-f274-404b-9f1b-3f2aeddf6787" acquired by "delete_volume" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:25 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6612a14a-31ca-494f-a345-23aaa1589f18]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:25 devstack sudo[105520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787
Jul 04 00:13:25 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:25 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b" returned: 0 in 0.650s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:25 devstack sudo[105523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.info
Jul 04 00:13:25 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:26 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787" returned: 0 in 0.775s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:26 devstack sudo[105534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787
Jul 04 00:13:26 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:26 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.info" returned: 0 in 0.681s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:26 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.info is being set with open permissions: ugo+rw
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:26 devstack sudo[105537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.info
Jul 04 00:13:26 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:26 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-5e7c1db1-f274-404b-9f1b-3f2aeddf6787" returned: 0 in 0.649s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-5e7c1db1-f274-404b-9f1b-3f2aeddf6787" released by "delete_volume" :: held 1.480s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=147,cinder:SELECT=107,cinder:INSERT=40,cinder:DELETE=13 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=120,cinder:UPDATE=136,cinder:DELETE=11,cinder:INSERT=34 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Created reservations ['03c53e35-ab63-4223-9100-42de38c4b1f8', 'ec92dcaa-c14e-4208-a2a7-7258cef80736', '9b3e3e9c-7b0e-444c-978b-de1fd905ccd5', 'e205d096-0b24-459c-9400-d5d549b98c6e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:26 devstack sudo[105541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:13:26 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:26 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.info" returned: 0 in 0.681s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.413s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:26 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8c54dbbd-b87a-43a9-8c04-37eb48a5017e tempest-ProjectReaderTests-762732484 None] Create snapshot completed successfully
Jul 04 00:13:27 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.632s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:13:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Deleted volume successfully.
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4f8cb404-4996-4871-bcd8-ec450dd75788 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-5e7c1db1-f274-404b-9f1b-3f2aeddf6787-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-f0f3ab0e-3937-4621-ba0c-47e837640a0b-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Lock "cinder-f0f3ab0e-3937-4621-ba0c-47e837640a0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-861720f9-07e8-4087-bd68-c395e26ab778" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-861720f9-07e8-4087-bd68-c395e26ab778" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-f0f3ab0e-3937-4621-ba0c-47e837640a0b" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-f0f3ab0e-3937-4621-ba0c-47e837640a0b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Deleting offline snapshot f0f3ab0e-3937-4621-ba0c-47e837640a0b of volume 861720f9-07e8-4087-bd68-c395e26ab778 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] snapshot_file for this snap is: volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2615b8a-59e2-47f1-ad3c-314f2030159d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (d2619f60-0057-4d05-ab95-614c2e6b1450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378da100-3340-4607-935d-e480b319d6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378da100-3340-4607-935d-e480b319d6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-249976806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf72701-b9f2-480e-bf17-2ce02ecd71b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:28Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4134a24-12bc-4fef-9a0a-184fec591d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4134a24-12bc-4fef-9a0a-184fec591d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da29d366-8290-45aa-88e5-4a44138ccfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da29d366-8290-45aa-88e5-4a44138ccfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf72701-b9f2-480e-bf17-2ce02ecd71b4', 'volume_name': 'volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b9b32a-4f5f-4de0-bedb-a317e90df136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b9b32a-4f5f-4de0-bedb-a317e90df136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:27 devstack sudo[105544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b
Jul 04 00:13:27 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6750d1-a3d6-457a-891b-399a8bf78c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:27 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Volume 1cf72701-b9f2-480e-bf17-2ce02ecd71b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4', 'volume_size': 1}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-249976806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf72701-b9f2-480e-bf17-2ce02ecd71b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:28Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Creating volume 1cf72701-b9f2-480e-bf17-2ce02ecd71b4 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:13:27 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:13:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:27 devstack sudo[105546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4 1073741824
Jul 04 00:13:27 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:28 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b" returned: 0 in 0.811s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-861720f9-07e8-4087-bd68-c395e26ab778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:13:28 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52ea509-f0e2-4d27-84a6-1c346c1a0af3]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:28 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4 1073741824" returned: 0 in 0.830s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:28 devstack sudo[105555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778
Jul 04 00:13:28 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:28 devstack sudo[105557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4
Jul 04 00:13:28 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:29 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778" returned: 0 in 0.813s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:29 devstack sudo[105563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b
Jul 04 00:13:29 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:29 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4" returned: 0 in 0.723s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:13:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df6750d1-a3d6-457a-891b-399a8bf78c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1339b864-5e7c-4313-89f4-f88a2943bfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:29 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Volume volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4 (1cf72701-b9f2-480e-bf17-2ce02ecd71b4): created successfully
Jul 04 00:13:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1339b864-5e7c-4313-89f4-f88a2943bfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (d2619f60-0057-4d05-ab95-614c2e6b1450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:13:29 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e1c9ece4-c620-4f9f-abcd-b2f0e222873f tempest-ProjectMemberTests-1651402342 None] Created volume successfully.
Jul 04 00:13:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] Creating offline snapshot 7d96efbc-ebc7-489b-aa5d-d7e00ec70241 of volume 1cf72701-b9f2-480e-bf17-2ce02ecd71b4 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:13:30 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc0f3f8-b41b-4e2b-a0b4-8ce241affeb9]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:30 devstack sudo[105568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4
Jul 04 00:13:30 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:30 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b" returned: 0 in 0.826s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:30 devstack sudo[105570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b
Jul 04 00:13:30 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:30 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4" returned: 0 in 0.827s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:31 devstack sudo[105577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241 1G
Jul 04 00:13:31 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:31 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778.f0f3ab0e-3937-4621-ba0c-47e837640a0b" returned: 0 in 0.710s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-f0f3ab0e-3937-4621-ba0c-47e837640a0b" released by "_delete_snapshot" :: held 3.260s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-861720f9-07e8-4087-bd68-c395e26ab778" released by "delete_snapshot" :: held 3.283s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:31 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Created reservations ['c5771e14-98ee-4911-89b1-13662ee21e19', 'f4944cda-95f0-47b2-83a6-ba36ad8f815e', '47804d0f-a10f-43a2-8e8e-597f00288412', '9b62dc52-9628-405c-82ed-ce8b39748867'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:31 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Delete snapshot completed successfully.
Jul 04 00:13:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4beeb610-e497-40a4-a07d-e90729364042 tempest-ProjectReaderTests-762732484 None] Lock "cinder-f0f3ab0e-3937-4621-ba0c-47e837640a0b-delete_snapshot" released by "delete_snapshot" :: held 3.454s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:31 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241 1G" returned: 0 in 0.807s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:31 devstack sudo[105582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241
Jul 04 00:13:31 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-861720f9-07e8-4087-bd68-c395e26ab778-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Lock "cinder-861720f9-07e8-4087-bd68-c395e26ab778-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-861720f9-07e8-4087-bd68-c395e26ab778" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-861720f9-07e8-4087-bd68-c395e26ab778" acquired by "delete_volume" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:32 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d56181d-0e73-4487-b6b8-1bd7c14e53a1]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:32 devstack sudo[105584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778
Jul 04 00:13:32 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:32 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241" returned: 0 in 0.720s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:32 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241 is being set with open permissions: ugo+rw
Jul 04 00:13:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:32 devstack sudo[105589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241
Jul 04 00:13:32 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:32 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778" returned: 0 in 0.779s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:32 devstack sudo[105594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778
Jul 04 00:13:32 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:33 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241" returned: 0 in 0.685s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:33 devstack sudo[105597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.info
Jul 04 00:13:33 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:33 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-861720f9-07e8-4087-bd68-c395e26ab778" returned: 0 in 0.690s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-861720f9-07e8-4087-bd68-c395e26ab778" released by "delete_volume" :: held 1.531s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Created reservations ['f377cede-51f5-4ff2-a5c6-a3449ffa0336', 'f6e7f379-6ed8-4055-8d72-dea23dfee53e', 'c9100d6b-e908-41eb-9f68-cc0358d6df8f', 'de1a2c18-31a0-480c-b81c-702cb22f0fd9'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:33 devstack sudo[105600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:13:33 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:33 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.info" returned: 0 in 0.697s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:33 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.info is being set with open permissions: ugo+rw
Jul 04 00:13:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:33 devstack sudo[105603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.info
Jul 04 00:13:33 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:34 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.712s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:13:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Deleted volume successfully.
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-c088d212-7763-4514-81e1-c285c4b074d8 tempest-ProjectReaderTests-762732484 None] Lock "cinder-861720f9-07e8-4087-bd68-c395e26ab778-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:34 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.info" returned: 0 in 0.741s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.560s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:34 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-eba44513-16be-4df2-90fb-7a5e2ed2a112 tempest-ProjectMemberTests-1651402342 None] Create snapshot completed successfully
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Flow 'volume_create_manager' (307e5a03-7b01-4682-aecd-634a4c7cb756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81701c4e-6f3a-48a8-bf5c-ac70ef22db04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81701c4e-6f3a-48a8-bf5c-ac70ef22db04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-218591905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38015392-87e2-4653-b7f4-6119fd8bd9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043ab7c2bf5c4bd1b7bce510ae92f54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:35Z,use_quota=True,user_id='834d3fa91ba04d969e15a3a9ab7587e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fc5492-18a0-4efa-b125-43349f2561b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fc5492-18a0-4efa-b125-43349f2561b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69989dfb-0e2b-442b-816c-e7cebaca266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69989dfb-0e2b-442b-816c-e7cebaca266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38015392-87e2-4653-b7f4-6119fd8bd9c3', 'volume_name': 'volume-38015392-87e2-4653-b7f4-6119fd8bd9c3', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9cb2ad-e7b3-447d-a8a7-d635594f8773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9cb2ad-e7b3-447d-a8a7-d635594f8773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074276e1-e563-46a9-a597-57eef286c1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:34 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Volume 38015392-87e2-4653-b7f4-6119fd8bd9c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38015392-87e2-4653-b7f4-6119fd8bd9c3', 'volume_size': 1}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:13:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-218591905',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38015392-87e2-4653-b7f4-6119fd8bd9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043ab7c2bf5c4bd1b7bce510ae92f54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:35Z,use_quota=True,user_id='834d3fa91ba04d969e15a3a9ab7587e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Creating volume 38015392-87e2-4653-b7f4-6119fd8bd9c3 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:13:34 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:13:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:34 devstack sudo[105607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3 1073741824
Jul 04 00:13:34 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-7d96efbc-ebc7-489b-aa5d-d7e00ec70241-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Lock "cinder-7d96efbc-ebc7-489b-aa5d-d7e00ec70241-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-1cf72701-b9f2-480e-bf17-2ce02ecd71b4" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-1cf72701-b9f2-480e-bf17-2ce02ecd71b4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-7d96efbc-ebc7-489b-aa5d-d7e00ec70241" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-7d96efbc-ebc7-489b-aa5d-d7e00ec70241" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Deleting offline snapshot 7d96efbc-ebc7-489b-aa5d-d7e00ec70241 of volume 1cf72701-b9f2-480e-bf17-2ce02ecd71b4 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:13:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] snapshot_file for this snap is: volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:13:35 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[444caf92-24e5-4739-b706-202a5e22a087]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:35 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241
Jul 04 00:13:35 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:35 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3 1073741824" returned: 0 in 0.871s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:35 devstack sudo[105615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3
Jul 04 00:13:35 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:36 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241" returned: 0 in 0.838s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b0a8c3-1887-4e88-80d1-33149ec286c8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:36 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3" returned: 0 in 0.653s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074276e1-e563-46a9-a597-57eef286c1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38015392-87e2-4653-b7f4-6119fd8bd9c3', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a054af-1560-4bc2-9a06-5af1b2724269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:36 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Volume volume-38015392-87e2-4653-b7f4-6119fd8bd9c3 (38015392-87e2-4653-b7f4-6119fd8bd9c3): created successfully
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a054af-1560-4bc2-9a06-5af1b2724269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Flow 'volume_create_manager' (307e5a03-7b01-4682-aecd-634a4c7cb756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:13:36 devstack sudo[105621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4
Jul 04 00:13:36 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:36 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4cb89fdd-38e5-44d5-b3bc-8ed67f818315 tempest-ProjectReaderTests-762732484 None] Created volume successfully.
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] Creating offline snapshot 1bb97c13-fe2a-478c-b41d-8e7b08f01f80 of volume 38015392-87e2-4653-b7f4-6119fd8bd9c3 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:13:37 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03ca7bb-32e4-4a8b-8e84-c5bff378051f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:37 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4" returned: 0 in 0.798s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:37 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3
Jul 04 00:13:37 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:37 devstack sudo[105628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241
Jul 04 00:13:37 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:37 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3" returned: 0 in 0.761s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.1bb97c13-fe2a-478c-b41d-8e7b08f01f80 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:37 devstack sudo[105637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.1bb97c13-fe2a-478c-b41d-8e7b08f01f80 1G
Jul 04 00:13:37 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:37 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241" returned: 0 in 0.761s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:37 devstack sudo[105639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241
Jul 04 00:13:37 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:38 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4.7d96efbc-ebc7-489b-aa5d-d7e00ec70241" returned: 0 in 0.646s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-7d96efbc-ebc7-489b-aa5d-d7e00ec70241" released by "_delete_snapshot" :: held 3.162s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-1cf72701-b9f2-480e-bf17-2ce02ecd71b4" released by "delete_snapshot" :: held 3.187s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:38 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.1bb97c13-fe2a-478c-b41d-8e7b08f01f80 1G" returned: 0 in 0.826s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38015392-87e2-4653-b7f4-6119fd8bd9c3 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.1bb97c13-fe2a-478c-b41d-8e7b08f01f80 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:38 devstack sudo[105646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38015392-87e2-4653-b7f4-6119fd8bd9c3 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.1bb97c13-fe2a-478c-b41d-8e7b08f01f80
Jul 04 00:13:38 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:38 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Created reservations ['08d9ed2b-b220-402f-93e6-6e35f4bda9b2', '0156dbaa-e7d7-4507-bbd2-ba220d83086f', '09c9582e-563d-462a-be36-73af8a2803ce', '66f25ff8-f8f7-4ff2-a1ca-39c77b4832d0'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Delete snapshot completed successfully.
Jul 04 00:13:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8b2ce985-8ee7-4f8f-9491-17f1783c627d tempest-ProjectMemberTests-1651402342 None] Lock "cinder-7d96efbc-ebc7-489b-aa5d-d7e00ec70241-delete_snapshot" released by "delete_snapshot" :: held 3.363s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:39 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38015392-87e2-4653-b7f4-6119fd8bd9c3 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.1bb97c13-fe2a-478c-b41d-8e7b08f01f80" returned: 0 in 0.737s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:39 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.1bb97c13-fe2a-478c-b41d-8e7b08f01f80 is being set with open permissions: ugo+rw
Jul 04 00:13:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.1bb97c13-fe2a-478c-b41d-8e7b08f01f80 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:39 devstack sudo[105651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.1bb97c13-fe2a-478c-b41d-8e7b08f01f80
Jul 04 00:13:39 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-1cf72701-b9f2-480e-bf17-2ce02ecd71b4-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-1cf72701-b9f2-480e-bf17-2ce02ecd71b4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-1cf72701-b9f2-480e-bf17-2ce02ecd71b4" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-1cf72701-b9f2-480e-bf17-2ce02ecd71b4" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:39 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd9a877-af19-40af-9a58-f6920ecb7990]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:39 devstack sudo[105653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4
Jul 04 00:13:39 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:40 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.1bb97c13-fe2a-478c-b41d-8e7b08f01f80" returned: 0 in 0.687s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:40 devstack sudo[105656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.info
Jul 04 00:13:40 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:40 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4" returned: 0 in 0.781s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:40 devstack sudo[105661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4
Jul 04 00:13:40 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:40 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.info" returned: 0 in 0.701s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:40 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.info is being set with open permissions: ugo+rw
Jul 04 00:13:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:40 devstack sudo[105664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.info
Jul 04 00:13:40 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:41 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-1cf72701-b9f2-480e-bf17-2ce02ecd71b4" returned: 0 in 0.711s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-1cf72701-b9f2-480e-bf17-2ce02ecd71b4" released by "delete_volume" :: held 1.551s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:41 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Created reservations ['b9b6257e-59b6-40eb-a251-30fea633bb60', 'a8318d10-7e7e-4be2-9379-692f39f5a620', '5b82adbd-6d46-49df-ab92-94b2309c12ad', '7c52d897-ae7d-473a-af87-8a87d293f63d'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:41 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:41 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-38015392-87e2-4653-b7f4-6119fd8bd9c3.info" returned: 0 in 0.627s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:41 devstack sudo[105669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:13:41 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.455s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:41 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-77225656-801c-45f0-b045-ead6cb49c209 tempest-ProjectReaderTests-762732484 None] Create snapshot completed successfully
Jul 04 00:13:42 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.757s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:13:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Deleted volume successfully.
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-49fc9733-de49-4d7d-b899-f8f2019d4b51 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-1cf72701-b9f2-480e-bf17-2ce02ecd71b4-delete_volume" released by "delete_volume" :: held 2.573s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2483c8fc-e74d-4e86-a019-ddb12b213a44 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-1bb97c13-fe2a-478c-b41d-8e7b08f01f80-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2483c8fc-e74d-4e86-a019-ddb12b213a44 tempest-ProjectReaderTests-762732484 None] Lock "cinder-1bb97c13-fe2a-478c-b41d-8e7b08f01f80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:42 devstack cinder-volume[86648]: INFO cinder.message.api [None req-2483c8fc-e74d-4e86-a019-ddb12b213a44 tempest-ProjectReaderTests-762732484 None] Creating message record for request_id = req-2483c8fc-e74d-4e86-a019-ddb12b213a44
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2483c8fc-e74d-4e86-a019-ddb12b213a44 tempest-ProjectReaderTests-762732484 None] Lock "cinder-1bb97c13-fe2a-478c-b41d-8e7b08f01f80-delete_snapshot" released by "delete_snapshot" :: held 0.067s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server [None req-2483c8fc-e74d-4e86-a019-ddb12b213a44 tempest-ProjectReaderTests-762732484 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, snapshot, *args, **kwargs)
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     self.driver.unmanage_snapshot(snapshot)
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 04 00:13:42 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server 
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (e4fd6d74-4a94-44a8-bf04-251f150b301e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3807d7-8bae-4a9c-8f05-f02b6cdff5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3807d7-8bae-4a9c-8f05-f02b6cdff5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-994552997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9beba4c-03cc-4f84-86fa-1d1b705194c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:42Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eef77cf-9f99-4701-bc00-f0a3e910f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eef77cf-9f99-4701-bc00-f0a3e910f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e03887-212b-4328-b86f-cdaf3ea6f78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e03887-212b-4328-b86f-cdaf3ea6f78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9beba4c-03cc-4f84-86fa-1d1b705194c4', 'volume_name': 'volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df068d50-fb3a-4ff4-bdfc-5e63712e26e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df068d50-fb3a-4ff4-bdfc-5e63712e26e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9ea17b-6c90-4638-b39c-1d4e831383c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:42 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Volume e9beba4c-03cc-4f84-86fa-1d1b705194c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4', 'volume_size': 1}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:13:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-994552997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9beba4c-03cc-4f84-86fa-1d1b705194c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:13:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:13:42Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Creating volume e9beba4c-03cc-4f84-86fa-1d1b705194c4 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:13:42 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:13:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:42 devstack sudo[105672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4 1073741824
Jul 04 00:13:42 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:43 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4 1073741824" returned: 0 in 0.912s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:43 devstack sudo[105678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4
Jul 04 00:13:43 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:44 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4" returned: 0 in 0.749s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:13:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9ea17b-6c90-4638-b39c-1d4e831383c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd65a47-1fba-4381-aea3-33c0e67ba80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:44 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Volume volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4 (e9beba4c-03cc-4f84-86fa-1d1b705194c4): created successfully
Jul 04 00:13:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd65a47-1fba-4381-aea3-33c0e67ba80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (e4fd6d74-4a94-44a8-bf04-251f150b301e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:13:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8b6dd16f-c206-47aa-97be-3e61553df61b tempest-ProjectMemberTests-1651402342 None] Created volume successfully.
Jul 04 00:13:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] Creating offline snapshot a9aaec20-c89c-4a2d-a5a9-cfeeef187009 of volume e9beba4c-03cc-4f84-86fa-1d1b705194c4 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:13:44 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce2741d-f508-478d-92be-7e5d2b246520]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:44 devstack sudo[105681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4
Jul 04 00:13:44 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:45 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4" returned: 0 in 0.846s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.a9aaec20-c89c-4a2d-a5a9-cfeeef187009 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:45 devstack sudo[105686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.a9aaec20-c89c-4a2d-a5a9-cfeeef187009 1G
Jul 04 00:13:45 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:46 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.a9aaec20-c89c-4a2d-a5a9-cfeeef187009 1G" returned: 0 in 0.817s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.a9aaec20-c89c-4a2d-a5a9-cfeeef187009 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:46 devstack sudo[105692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.a9aaec20-c89c-4a2d-a5a9-cfeeef187009
Jul 04 00:13:46 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:47 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.a9aaec20-c89c-4a2d-a5a9-cfeeef187009" returned: 0 in 0.703s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:47 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.a9aaec20-c89c-4a2d-a5a9-cfeeef187009 is being set with open permissions: ugo+rw
Jul 04 00:13:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.a9aaec20-c89c-4a2d-a5a9-cfeeef187009 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:47 devstack sudo[105698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.a9aaec20-c89c-4a2d-a5a9-cfeeef187009
Jul 04 00:13:47 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:47 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.a9aaec20-c89c-4a2d-a5a9-cfeeef187009" returned: 0 in 0.673s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:47 devstack sudo[105701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.info
Jul 04 00:13:47 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:48 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.info" returned: 0 in 0.650s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:48 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.info is being set with open permissions: ugo+rw
Jul 04 00:13:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:48 devstack sudo[105704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.info
Jul 04 00:13:48 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:49 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-e9beba4c-03cc-4f84-86fa-1d1b705194c4.info" returned: 0 in 0.628s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.408s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:49 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-77843c80-4cf2-42b4-83b8-aa5a68017249 tempest-ProjectMemberTests-1651402342 None] Create snapshot completed successfully
Jul 04 00:13:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2ca8a41b-0a1d-486d-9eb5-e2e5a0118287 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-a9aaec20-c89c-4a2d-a5a9-cfeeef187009-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2ca8a41b-0a1d-486d-9eb5-e2e5a0118287 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-a9aaec20-c89c-4a2d-a5a9-cfeeef187009-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:49 devstack cinder-volume[86648]: INFO cinder.message.api [None req-2ca8a41b-0a1d-486d-9eb5-e2e5a0118287 tempest-ProjectMemberTests-1651402342 None] Creating message record for request_id = req-2ca8a41b-0a1d-486d-9eb5-e2e5a0118287
Jul 04 00:13:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-2ca8a41b-0a1d-486d-9eb5-e2e5a0118287 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-a9aaec20-c89c-4a2d-a5a9-cfeeef187009-delete_snapshot" released by "delete_snapshot" :: held 0.034s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server [None req-2ca8a41b-0a1d-486d-9eb5-e2e5a0118287 tempest-ProjectMemberTests-1651402342 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, snapshot, *args, **kwargs)
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     self.driver.unmanage_snapshot(snapshot)
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 04 00:13:49 devstack cinder-volume[86648]: ERROR oslo_messaging.rpc.server 
Jul 04 00:13:59 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=41,cinder:INSERT=12,cinder:UPDATE=48,cinder:DELETE=4 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:13:59 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:INSERT=16,cinder:UPDATE=52,cinder:SELECT=32,cinder:DELETE=6 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:14:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:14:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:05 devstack sudo[105710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:14:05 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:05 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.708s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:14:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:14:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:14:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:15:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:15:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:05 devstack sudo[105768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:15:05 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:05 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.651s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:15:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:15:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:15:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:15:37 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:15:37 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:16:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:16:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:05 devstack sudo[105824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:16:05 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:05 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.678s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:16:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:16:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Flow 'volume_create_manager' (752521b5-77b2-4c96-a6e8-9ec825a0b364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670c57d0-744b-4014-8dc7-64099202c88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (670c57d0-744b-4014-8dc7-64099202c88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1292262738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4f49d7-158f-4104-96ae-f4a311bf04be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043ab7c2bf5c4bd1b7bce510ae92f54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:59Z,use_quota=True,user_id='834d3fa91ba04d969e15a3a9ab7587e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176ce5ad-76bb-46f8-9b6c-c1db5538dd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176ce5ad-76bb-46f8-9b6c-c1db5538dd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9c70d1-823a-4ad2-a879-1e6e08f358cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9c70d1-823a-4ad2-a879-1e6e08f358cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc4f49d7-158f-4104-96ae-f4a311bf04be', 'volume_name': 'volume-bc4f49d7-158f-4104-96ae-f4a311bf04be', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105445cf-9ad4-48cd-b150-5854e60414f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105445cf-9ad4-48cd-b150-5854e60414f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6edb293-1bc5-482e-9d49-b76df82abedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:58 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Volume bc4f49d7-158f-4104-96ae-f4a311bf04be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc4f49d7-158f-4104-96ae-f4a311bf04be', 'volume_size': 1}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1292262738',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4f49d7-158f-4104-96ae-f4a311bf04be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043ab7c2bf5c4bd1b7bce510ae92f54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:59Z,use_quota=True,user_id='834d3fa91ba04d969e15a3a9ab7587e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Creating volume bc4f49d7-158f-4104-96ae-f4a311bf04be {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:58 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:16:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:58 devstack sudo[105881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be 1073741824
Jul 04 00:16:58 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:59 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be 1073741824" returned: 0 in 0.801s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:59 devstack sudo[105887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be
Jul 04 00:16:59 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:00 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be" returned: 0 in 0.629s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6edb293-1bc5-482e-9d49-b76df82abedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4f49d7-158f-4104-96ae-f4a311bf04be', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f45746-8ad5-4e53-8799-6dcc89e992c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:00 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Volume volume-bc4f49d7-158f-4104-96ae-f4a311bf04be (bc4f49d7-158f-4104-96ae-f4a311bf04be): created successfully
Jul 04 00:17:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f45746-8ad5-4e53-8799-6dcc89e992c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:00 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Flow 'volume_create_manager' (752521b5-77b2-4c96-a6e8-9ec825a0b364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:00 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8aea4711-2341-4573-a664-9cf18a764d1d tempest-ProjectReaderTests-762732484 None] Created volume successfully.
Jul 04 00:17:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:00 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] Creating offline snapshot aebf657e-651f-4449-927a-3ca08344efd1 of volume bc4f49d7-158f-4104-96ae-f4a311bf04be {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:17:00 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[328bdb48-b132-43f6-8899-9c3f96de6538]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:00 devstack sudo[105890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be
Jul 04 00:17:00 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:01 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be" returned: 0 in 0.734s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:01 devstack sudo[105896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1 1G
Jul 04 00:17:01 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:02 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1 1G" returned: 0 in 0.816s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc4f49d7-158f-4104-96ae-f4a311bf04be -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:02 devstack sudo[105904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc4f49d7-158f-4104-96ae-f4a311bf04be -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1
Jul 04 00:17:02 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:03 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc4f49d7-158f-4104-96ae-f4a311bf04be -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1" returned: 0 in 0.655s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:03 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1 is being set with open permissions: ugo+rw
Jul 04 00:17:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:03 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1
Jul 04 00:17:03 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:03 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1" returned: 0 in 0.601s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:03 devstack sudo[105913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.info
Jul 04 00:17:03 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:04 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.info" returned: 0 in 0.609s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:04 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.info is being set with open permissions: ugo+rw
Jul 04 00:17:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:04 devstack sudo[105916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.info
Jul 04 00:17:04 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:04 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.info" returned: 0 in 0.604s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.097s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:04 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a9b09d53-5f63-4e50-af37-15373c50a10a tempest-ProjectReaderTests-762732484 None] Create snapshot completed successfully
Jul 04 00:17:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:17:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:05 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:17:05 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:05 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.661s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:17:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:17:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (a8dff6f9-d8ac-4485-bbdc-f1c18cd0e37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28022c81-7d8a-4ee3-820c-8ebd3ddd0bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-aebf657e-651f-4449-927a-3ca08344efd1-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28022c81-7d8a-4ee3-820c-8ebd3ddd0bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535803451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1dc10a9-f97f-4f3a-84da-3c266cbafc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:06Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ce0f23-6b36-43de-8739-9f867900a2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ce0f23-6b36-43de-8739-9f867900a2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0df1a2-1d33-4e6c-91db-f308cd6de727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0df1a2-1d33-4e6c-91db-f308cd6de727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1dc10a9-f97f-4f3a-84da-3c266cbafc27', 'volume_name': 'volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d87cf5b-81c2-4c1c-8bcc-b7b1fa97c328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d87cf5b-81c2-4c1c-8bcc-b7b1fa97c328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05d9deb-1211-4b8c-81ea-a06e34b32dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:06 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Volume f1dc10a9-f97f-4f3a-84da-3c266cbafc27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27', 'volume_size': 1}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-535803451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1dc10a9-f97f-4f3a-84da-3c266cbafc27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:06Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Creating volume f1dc10a9-f97f-4f3a-84da-3c266cbafc27 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:06 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Lock "cinder-aebf657e-651f-4449-927a-3ca08344efd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-bc4f49d7-158f-4104-96ae-f4a311bf04be" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:06 devstack sudo[105924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27 1073741824
Jul 04 00:17:06 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-bc4f49d7-158f-4104-96ae-f4a311bf04be" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-aebf657e-651f-4449-927a-3ca08344efd1" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-aebf657e-651f-4449-927a-3ca08344efd1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Deleting offline snapshot aebf657e-651f-4449-927a-3ca08344efd1 of volume bc4f49d7-158f-4104-96ae-f4a311bf04be {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] snapshot_file for this snap is: volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6218b95b-2fe0-42b4-9a6e-a220f9c2ed26]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:06 devstack sudo[105926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1
Jul 04 00:17:06 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:06 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27 1073741824" returned: 0 in 0.825s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:07 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1" returned: 0 in 0.792s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc4f49d7-158f-4104-96ae-f4a311bf04be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:17:07 devstack sudo[105934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27
Jul 04 00:17:07 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a2fd23-2778-437a-b004-5bcf77449b0a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:07 devstack sudo[105936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be
Jul 04 00:17:07 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:07 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27" returned: 0 in 0.639s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05d9deb-1211-4b8c-81ea-a06e34b32dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2cc1a9e-eae9-4189-a61d-9b3b19a63c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:07 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Volume volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27 (f1dc10a9-f97f-4f3a-84da-3c266cbafc27): created successfully
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2cc1a9e-eae9-4189-a61d-9b3b19a63c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (a8dff6f9-d8ac-4485-bbdc-f1c18cd0e37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:07 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-57784062-f615-40a8-96fd-235948721a4a tempest-ProjectMemberTests-1651402342 None] Created volume successfully.
Jul 04 00:17:07 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be" returned: 0 in 0.743s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:07 devstack sudo[105943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1
Jul 04 00:17:07 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:08 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] Creating offline snapshot 9069ad2e-b748-4d80-81d2-d489428aa71c of volume f1dc10a9-f97f-4f3a-84da-3c266cbafc27 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:17:08 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[50af03f9-1fc3-4c33-803a-5a3a1ea4e9b5]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:08 devstack sudo[105945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27
Jul 04 00:17:08 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:08 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1" returned: 0 in 0.748s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:08 devstack sudo[105950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1
Jul 04 00:17:08 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:09 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27" returned: 0 in 0.737s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:09 devstack sudo[105956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c 1G
Jul 04 00:17:09 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:09 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be.aebf657e-651f-4449-927a-3ca08344efd1" returned: 0 in 0.636s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-aebf657e-651f-4449-927a-3ca08344efd1" released by "_delete_snapshot" :: held 3.010s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-bc4f49d7-158f-4104-96ae-f4a311bf04be" released by "delete_snapshot" :: held 3.032s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:09 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Created reservations ['9007249b-6b6d-4aa6-892e-d20d4ad33326', '19ac14d8-0d70-4548-8502-99eaaef1693b', 'f9ec81a7-5f52-47af-899f-82a0c5c76052', '5ebb315a-5bb6-4914-858d-2e621884259e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Delete snapshot completed successfully.
Jul 04 00:17:09 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-4d099b18-b3ca-44b8-ab74-37eba58fa791 tempest-ProjectReaderTests-762732484 None] Lock "cinder-aebf657e-651f-4449-927a-3ca08344efd1-delete_snapshot" released by "delete_snapshot" :: held 3.174s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:09 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c 1G" returned: 0 in 0.762s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:09 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c
Jul 04 00:17:09 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-bc4f49d7-158f-4104-96ae-f4a311bf04be-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Lock "cinder-bc4f49d7-158f-4104-96ae-f4a311bf04be-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-bc4f49d7-158f-4104-96ae-f4a311bf04be" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-bc4f49d7-158f-4104-96ae-f4a311bf04be" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:10 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[71119696-09bf-42fa-8cb8-1936f9fdbbaa]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:10 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c" returned: 0 in 0.663s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:10 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c is being set with open permissions: ugo+rw
Jul 04 00:17:10 devstack sudo[105968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be
Jul 04 00:17:10 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:10 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:10 devstack sudo[105970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c
Jul 04 00:17:10 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:11 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:11 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c" returned: 0 in 0.642s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be" returned: 0 in 0.755s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:11 devstack sudo[105977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be
Jul 04 00:17:11 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:11 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.info
Jul 04 00:17:11 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:11 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-bc4f49d7-158f-4104-96ae-f4a311bf04be" returned: 0 in 0.636s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-bc4f49d7-158f-4104-96ae-f4a311bf04be" released by "delete_volume" :: held 1.444s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:11 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.info" returned: 0 in 0.642s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:11 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.info is being set with open permissions: ugo+rw
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:11 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.info
Jul 04 00:17:11 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Created reservations ['f8dd3540-ee8e-496d-8234-6432afca43b3', '8b94b802-42d0-4e3d-8716-8bd57a6e2eed', '2e410f70-597b-4378-922e-39077bd06ac8', '5651aa27-a169-4743-a4df-e31d4446c8fa'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:11 devstack sudo[105985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:17:11 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:12 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.info" returned: 0 in 0.621s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.166s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-ca948b46-cdcf-42f4-9e0b-28bc1c83487a tempest-ProjectMemberTests-1651402342 None] Create snapshot completed successfully
Jul 04 00:17:12 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.628s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:12 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:12 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Deleted volume successfully.
Jul 04 00:17:12 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-50e02d85-fb06-4974-ba25-c8a5c951a6df tempest-ProjectReaderTests-762732484 None] Lock "cinder-bc4f49d7-158f-4104-96ae-f4a311bf04be-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:12 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:17:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Flow 'volume_create_manager' (bcdae78d-1de8-4b8b-8f58-9e3ab8b3435f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7c1bec-659e-4e7e-830f-37de2d2daace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7c1bec-659e-4e7e-830f-37de2d2daace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1297753059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6e1da5-34fe-4405-9465-21aa185fe3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043ab7c2bf5c4bd1b7bce510ae92f54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:13Z,use_quota=True,user_id='834d3fa91ba04d969e15a3a9ab7587e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c966d29b-00ed-4e76-bfba-712ab4de0a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:12 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c966d29b-00ed-4e76-bfba-712ab4de0a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8c8563-2068-4e36-931a-f818748b066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8c8563-2068-4e36-931a-f818748b066a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da6e1da5-34fe-4405-9465-21aa185fe3b4', 'volume_name': 'volume-da6e1da5-34fe-4405-9465-21aa185fe3b4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c599268-e2bc-4521-b73f-653c1015845d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c599268-e2bc-4521-b73f-653c1015845d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbf69f3-43ac-458c-a15d-70845294b1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:13 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Volume da6e1da5-34fe-4405-9465-21aa185fe3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da6e1da5-34fe-4405-9465-21aa185fe3b4', 'volume_size': 1}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1297753059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da6e1da5-34fe-4405-9465-21aa185fe3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043ab7c2bf5c4bd1b7bce510ae92f54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:13Z,use_quota=True,user_id='834d3fa91ba04d969e15a3a9ab7587e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Creating volume da6e1da5-34fe-4405-9465-21aa185fe3b4 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:13 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:13 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4 1073741824
Jul 04 00:17:13 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-9069ad2e-b748-4d80-81d2-d489428aa71c-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Lock "cinder-9069ad2e-b748-4d80-81d2-d489428aa71c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-f1dc10a9-f97f-4f3a-84da-3c266cbafc27" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-f1dc10a9-f97f-4f3a-84da-3c266cbafc27" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-9069ad2e-b748-4d80-81d2-d489428aa71c" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-9069ad2e-b748-4d80-81d2-d489428aa71c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Deleting offline snapshot 9069ad2e-b748-4d80-81d2-d489428aa71c of volume f1dc10a9-f97f-4f3a-84da-3c266cbafc27 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] snapshot_file for this snap is: volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6ed755-4f5c-439b-ba71-c531826d4a78]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:13 devstack sudo[105994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c
Jul 04 00:17:13 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:13 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4 1073741824" returned: 0 in 0.797s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:13 devstack sudo[105997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4
Jul 04 00:17:13 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:14 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c" returned: 0 in 0.757s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:17:14 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1d1e5f-2b49-4711-b9e8-85a3ff0e0be8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:14 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4" returned: 0 in 0.630s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:14 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbf69f3-43ac-458c-a15d-70845294b1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da6e1da5-34fe-4405-9465-21aa185fe3b4', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ace90f-bdfe-4b44-a034-f4c4b9228b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:14 devstack sudo[106003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27
Jul 04 00:17:14 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:14 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Volume volume-da6e1da5-34fe-4405-9465-21aa185fe3b4 (da6e1da5-34fe-4405-9465-21aa185fe3b4): created successfully
Jul 04 00:17:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ace90f-bdfe-4b44-a034-f4c4b9228b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:14 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Flow 'volume_create_manager' (bcdae78d-1de8-4b8b-8f58-9e3ab8b3435f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:14 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-eb2d70ea-03f9-4146-b569-0af98ebabcf8 tempest-ProjectReaderTests-762732484 None] Created volume successfully.
Jul 04 00:17:15 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27" returned: 0 in 0.760s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:15 devstack sudo[106008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c
Jul 04 00:17:15 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] Creating offline snapshot 48e0124c-50db-4e17-9ea9-3fbb9fa4737d of volume da6e1da5-34fe-4405-9465-21aa185fe3b4 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:17:15 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca1d507-7ad5-4de4-afe2-c18a88ca65e8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:15 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4
Jul 04 00:17:15 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:15 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c" returned: 0 in 0.717s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:15 devstack sudo[106017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c
Jul 04 00:17:15 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:16 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4" returned: 0 in 0.776s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:16 devstack sudo[106020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d 1G
Jul 04 00:17:16 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:16 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27.9069ad2e-b748-4d80-81d2-d489428aa71c" returned: 0 in 0.651s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-9069ad2e-b748-4d80-81d2-d489428aa71c" released by "_delete_snapshot" :: held 2.977s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-f1dc10a9-f97f-4f3a-84da-3c266cbafc27" released by "delete_snapshot" :: held 3.000s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:16 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Created reservations ['a5c3b798-c7fe-472b-86fb-2926dc02f992', '50800b7d-9caf-45ec-a2ec-a774fcdac3b8', '632897e5-e8f4-41cb-ab0e-094b6feea44e', 'f334b88c-1974-4dd3-9859-fd2eb2190d45'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:16 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Delete snapshot completed successfully.
Jul 04 00:17:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-1357884c-c1fb-4759-8695-69d980a9601b tempest-ProjectMemberTests-1651402342 None] Lock "cinder-9069ad2e-b748-4d80-81d2-d489428aa71c-delete_snapshot" released by "delete_snapshot" :: held 3.156s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:16 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d 1G" returned: 0 in 0.794s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da6e1da5-34fe-4405-9465-21aa185fe3b4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:16 devstack sudo[106027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da6e1da5-34fe-4405-9465-21aa185fe3b4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d
Jul 04 00:17:16 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:17 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da6e1da5-34fe-4405-9465-21aa185fe3b4 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d" returned: 0 in 0.662s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:17 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d is being set with open permissions: ugo+rw
Jul 04 00:17:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:17 devstack sudo[106032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d
Jul 04 00:17:17 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-f1dc10a9-f97f-4f3a-84da-3c266cbafc27-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-f1dc10a9-f97f-4f3a-84da-3c266cbafc27-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-f1dc10a9-f97f-4f3a-84da-3c266cbafc27" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:17 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-f1dc10a9-f97f-4f3a-84da-3c266cbafc27" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:17 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[90994cab-9383-4423-92c4-d246ad99ee41]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:17 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:18 devstack sudo[106034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27
Jul 04 00:17:18 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:18 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d" returned: 0 in 0.653s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:18 devstack sudo[106037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.info
Jul 04 00:17:18 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:18 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27" returned: 0 in 0.762s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:18 devstack sudo[106042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27
Jul 04 00:17:18 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:18 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.info" returned: 0 in 0.658s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:18 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.info is being set with open permissions: ugo+rw
Jul 04 00:17:18 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:18 devstack sudo[106045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.info
Jul 04 00:17:18 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:19 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-f1dc10a9-f97f-4f3a-84da-3c266cbafc27" returned: 0 in 0.700s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:19 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-f1dc10a9-f97f-4f3a-84da-3c266cbafc27" released by "delete_volume" :: held 1.545s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:19 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:19 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Created reservations ['6c07b701-bfc0-4576-a236-702934f6aa92', 'f785e512-f138-43e9-82f7-3906f874eb99', 'cf03317a-ed59-4d0a-a7e2-cec507f553f1', '533e1222-03ad-4ab5-8f76-681d044114ca'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.info" returned: 0 in 0.665s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.288s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:19 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b101b414-c852-4198-8bba-85398b053d60 tempest-ProjectReaderTests-762732484 None] Create snapshot completed successfully
Jul 04 00:17:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:19 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:19 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:19 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:17:19 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:20 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.622s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:20 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Deleted volume successfully.
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-812df2e8-1cfa-4f52-a5cd-8c055150aa29 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-f1dc10a9-f97f-4f3a-84da-3c266cbafc27-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-48e0124c-50db-4e17-9ea9-3fbb9fa4737d-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Lock "cinder-48e0124c-50db-4e17-9ea9-3fbb9fa4737d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-da6e1da5-34fe-4405-9465-21aa185fe3b4" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-da6e1da5-34fe-4405-9465-21aa185fe3b4" acquired by "delete_snapshot" :: waited 0.080s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-48e0124c-50db-4e17-9ea9-3fbb9fa4737d" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-48e0124c-50db-4e17-9ea9-3fbb9fa4737d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Deleting offline snapshot 48e0124c-50db-4e17-9ea9-3fbb9fa4737d of volume da6e1da5-34fe-4405-9465-21aa185fe3b4 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] snapshot_file for this snap is: volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (672a9242-b286-44e4-9f59-004b414a4e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da79ac8b-3082-4225-b5ce-e3014518cc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdb62c4-4c92-4178-911d-f5ef22c8566a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da79ac8b-3082-4225-b5ce-e3014518cc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1761680291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f78c051-49da-4dc0-9d4a-56d2e43c0d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:21Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276bc9f3-6d54-46af-ae1b-e72fda6ac72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276bc9f3-6d54-46af-ae1b-e72fda6ac72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a8da13-5ae5-4944-9594-c82b3bedd290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14a8da13-5ae5-4944-9594-c82b3bedd290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f78c051-49da-4dc0-9d4a-56d2e43c0d59', 'volume_name': 'volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c29e39-c541-4d68-86ea-7cfe866eafd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c29e39-c541-4d68-86ea-7cfe866eafd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163d03d7-7369-4557-8a40-31567d082cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:20 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Volume 2f78c051-49da-4dc0-9d4a-56d2e43c0d59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59', 'volume_size': 1}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1761680291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f78c051-49da-4dc0-9d4a-56d2e43c0d59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:21Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Creating volume 2f78c051-49da-4dc0-9d4a-56d2e43c0d59 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:20 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:17:20 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:20 devstack sudo[106089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59 1073741824
Jul 04 00:17:20 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:20 devstack sudo[106088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d
Jul 04 00:17:20 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:21 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d" returned: 0 in 0.811s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:21 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da6e1da5-34fe-4405-9465-21aa185fe3b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:17:21 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[654378d6-711c-4f3c-8f03-da0ddd0bf51b]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:21 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59 1073741824" returned: 0 in 0.830s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:21 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:21 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59
Jul 04 00:17:21 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:21 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4
Jul 04 00:17:21 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:22 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4" returned: 0 in 0.734s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:22 devstack sudo[106108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d
Jul 04 00:17:22 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:22 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59" returned: 0 in 0.726s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163d03d7-7369-4557-8a40-31567d082cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139e238f-eba4-4d96-ada3-c9b68a2c2c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:22 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Volume volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59 (2f78c051-49da-4dc0-9d4a-56d2e43c0d59): created successfully
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139e238f-eba4-4d96-ada3-c9b68a2c2c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (672a9242-b286-44e4-9f59-004b414a4e9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:22 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-3d00946d-694c-4cb2-b07c-773e4ff5248a tempest-ProjectMemberTests-1651402342 None] Created volume successfully.
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] Creating offline snapshot a2981f26-31a3-4584-9934-832266cfa1e9 of volume 2f78c051-49da-4dc0-9d4a-56d2e43c0d59 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d6027d-8fb0-478b-b938-81cbd01dce87]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:22 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:22 devstack sudo[106112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59
Jul 04 00:17:22 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:23 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d" returned: 0 in 0.791s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:23 devstack sudo[106116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d
Jul 04 00:17:23 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:23 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59" returned: 0 in 0.790s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:23 devstack sudo[106122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9 1G
Jul 04 00:17:23 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:23 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:23 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4.48e0124c-50db-4e17-9ea9-3fbb9fa4737d" returned: 0 in 0.628s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-48e0124c-50db-4e17-9ea9-3fbb9fa4737d" released by "_delete_snapshot" :: held 3.120s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-da6e1da5-34fe-4405-9465-21aa185fe3b4" released by "delete_snapshot" :: held 3.152s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:23 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Created reservations ['c684aeb0-ec40-42aa-ad28-b6a322ce131a', '02d18dda-e693-46f4-ac42-03176c88e18c', '741987a8-d9d7-41f4-b2ff-5783ea46ddd6', '6d096e6b-bece-47db-a793-4998eb4e8509'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:23 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Delete snapshot completed successfully.
Jul 04 00:17:23 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a8462c5e-5ea8-434e-9419-2cb69feedd41 tempest-ProjectReaderTests-762732484 None] Lock "cinder-48e0124c-50db-4e17-9ea9-3fbb9fa4737d-delete_snapshot" released by "delete_snapshot" :: held 3.362s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:24 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9 1G" returned: 0 in 0.848s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:24 devstack sudo[106127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9
Jul 04 00:17:24 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-da6e1da5-34fe-4405-9465-21aa185fe3b4-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Lock "cinder-da6e1da5-34fe-4405-9465-21aa185fe3b4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-da6e1da5-34fe-4405-9465-21aa185fe3b4" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:24 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-da6e1da5-34fe-4405-9465-21aa185fe3b4" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:24 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[25037e72-eb75-4355-b566-62ba7e47d71c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:24 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:24 devstack sudo[106129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4
Jul 04 00:17:24 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:25 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9" returned: 0 in 0.805s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:25 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9 is being set with open permissions: ugo+rw
Jul 04 00:17:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:25 devstack sudo[106134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9
Jul 04 00:17:25 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:25 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4" returned: 0 in 0.751s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:25 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:25 devstack sudo[106139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4
Jul 04 00:17:25 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:25 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9" returned: 0 in 0.709s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:26 devstack sudo[106142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.info
Jul 04 00:17:26 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:26 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-da6e1da5-34fe-4405-9465-21aa185fe3b4" returned: 0 in 0.641s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-da6e1da5-34fe-4405-9465-21aa185fe3b4" released by "delete_volume" :: held 1.451s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Created reservations ['d4790545-e057-4207-9b41-a17a78559ac5', 'dc7a1ab0-6e73-4027-8c22-6fc4bdb72ddb', '2ac29682-7adf-41de-b522-e1ec52009008', '6e5fa651-af2a-43c8-9088-27245ba30eb6'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:26 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:17:26 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:26 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.info" returned: 0 in 0.721s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:26 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.info is being set with open permissions: ugo+rw
Jul 04 00:17:26 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:26 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.info
Jul 04 00:17:26 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:27 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.661s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Deleted volume successfully.
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-df44e712-b8f4-4251-8c28-e5bd3694883e tempest-ProjectReaderTests-762732484 None] Lock "cinder-da6e1da5-34fe-4405-9465-21aa185fe3b4-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:17:27 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Flow 'volume_create_manager' (dd1d850a-5083-4f92-8ef7-41e974436e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4aaf580-2f58-4560-890c-763fdb2a322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.info" returned: 0 in 0.728s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.687s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4aaf580-2f58-4560-890c-763fdb2a322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158673876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb72e0fe-ce14-4adc-8d88-a22acd75855e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043ab7c2bf5c4bd1b7bce510ae92f54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:27Z,use_quota=True,user_id='834d3fa91ba04d969e15a3a9ab7587e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b453f00-02eb-43bd-95d6-1f5056316eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b453f00-02eb-43bd-95d6-1f5056316eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d69065-69ac-4fea-8088-09b28127dbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d69065-69ac-4fea-8088-09b28127dbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb72e0fe-ce14-4adc-8d88-a22acd75855e', 'volume_name': 'volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf3e52c-cd9f-47c7-b7c8-adeb4d3a55a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf3e52c-cd9f-47c7-b7c8-adeb4d3a55a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903f634d-1cb2-45c4-9287-4081130c14e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:27 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Volume cb72e0fe-ce14-4adc-8d88-a22acd75855e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e', 'volume_size': 1}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1158673876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb72e0fe-ce14-4adc-8d88-a22acd75855e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='043ab7c2bf5c4bd1b7bce510ae92f54b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:27Z,use_quota=True,user_id='834d3fa91ba04d969e15a3a9ab7587e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Creating volume cb72e0fe-ce14-4adc-8d88-a22acd75855e {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:27 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:17:27 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:27 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e 1073741824
Jul 04 00:17:27 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:27 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-083a5dc4-35a0-4757-8a7e-f185a3833dfc tempest-ProjectMemberTests-1651402342 None] Create snapshot completed successfully
Jul 04 00:17:28 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e 1073741824" returned: 0 in 0.788s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:28 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e
Jul 04 00:17:28 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-a2981f26-31a3-4584-9934-832266cfa1e9-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-a2981f26-31a3-4584-9934-832266cfa1e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-2f78c051-49da-4dc0-9d4a-56d2e43c0d59" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-2f78c051-49da-4dc0-9d4a-56d2e43c0d59" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-a2981f26-31a3-4584-9934-832266cfa1e9" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:28 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-a2981f26-31a3-4584-9934-832266cfa1e9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Deleting offline snapshot a2981f26-31a3-4584-9934-832266cfa1e9 of volume 2f78c051-49da-4dc0-9d4a-56d2e43c0d59 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:17:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] snapshot_file for this snap is: volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:17:28 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[77265fe1-7314-46ec-983b-2fb7627049af]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:28 devstack sudo[106166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9
Jul 04 00:17:28 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:29 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e" returned: 0 in 0.657s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903f634d-1cb2-45c4-9287-4081130c14e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13119305-bbb9-42da-9c6a-b88d7267ea5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:29 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Volume volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e (cb72e0fe-ce14-4adc-8d88-a22acd75855e): created successfully
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13119305-bbb9-42da-9c6a-b88d7267ea5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Flow 'volume_create_manager' (dd1d850a-5083-4f92-8ef7-41e974436e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:29 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a4a3941e-e911-4e99-8585-e2e149910c59 tempest-ProjectReaderTests-762732484 None] Created volume successfully.
Jul 04 00:17:29 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9" returned: 0 in 0.751s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafb7435-3930-4141-a4f0-780d0374866f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:29 devstack sudo[106172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59
Jul 04 00:17:29 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] Creating offline snapshot 465d67d0-6e22-44f6-95c2-7153e3785fcf of volume cb72e0fe-ce14-4adc-8d88-a22acd75855e {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dffef7-d20c-4133-aa37-b08cdac2675c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:29 devstack sudo[106174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e
Jul 04 00:17:29 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:30 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59" returned: 0 in 0.800s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:30 devstack sudo[106179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9
Jul 04 00:17:30 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:30 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e" returned: 0 in 0.789s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:30 devstack sudo[106184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf 1G
Jul 04 00:17:30 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:30 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9" returned: 0 in 0.745s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:30 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9
Jul 04 00:17:30 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:31 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf 1G" returned: 0 in 0.775s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:31 devstack sudo[106195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf
Jul 04 00:17:31 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:31 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59.a2981f26-31a3-4584-9934-832266cfa1e9" returned: 0 in 0.638s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-a2981f26-31a3-4584-9934-832266cfa1e9" released by "_delete_snapshot" :: held 3.022s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-2f78c051-49da-4dc0-9d4a-56d2e43c0d59" released by "delete_snapshot" :: held 3.045s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:31 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Created reservations ['c96ad918-30bb-4e81-a747-665731efc679', '59c871ee-c9d8-40cd-962d-816a6592f864', '082db6e1-8b87-4380-bdd5-45d3316fb610', '95f03f9a-1164-4c0f-b35b-509b9f7aba8e'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:31 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Delete snapshot completed successfully.
Jul 04 00:17:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3ab315a9-026f-4997-a082-e61498dfe035 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-a2981f26-31a3-4584-9934-832266cfa1e9-delete_snapshot" released by "delete_snapshot" :: held 3.193s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:31 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf" returned: 0 in 0.658s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:31 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf is being set with open permissions: ugo+rw
Jul 04 00:17:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:31 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf
Jul 04 00:17:31 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:32 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf" returned: 0 in 0.600s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:32 devstack sudo[106204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.info
Jul 04 00:17:32 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-2f78c051-49da-4dc0-9d4a-56d2e43c0d59-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-2f78c051-49da-4dc0-9d4a-56d2e43c0d59-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-2f78c051-49da-4dc0-9d4a-56d2e43c0d59" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-2f78c051-49da-4dc0-9d4a-56d2e43c0d59" acquired by "delete_volume" :: waited 0.013s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:32 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3e5d28-e991-4479-a7d5-e8bab1aa579d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:32 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59
Jul 04 00:17:32 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:33 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.info" returned: 0 in 0.642s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:33 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.info is being set with open permissions: ugo+rw
Jul 04 00:17:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:33 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.info
Jul 04 00:17:33 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:33 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59" returned: 0 in 0.749s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:33 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59
Jul 04 00:17:33 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:33 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.info" returned: 0 in 0.656s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.207s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:33 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-56711679-7b88-47fa-9011-f55cd9efeab4 tempest-ProjectReaderTests-762732484 None] Create snapshot completed successfully
Jul 04 00:17:34 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-2f78c051-49da-4dc0-9d4a-56d2e43c0d59" returned: 0 in 0.616s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-2f78c051-49da-4dc0-9d4a-56d2e43c0d59" released by "delete_volume" :: held 1.419s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Created reservations ['5de9db55-a3c6-40b2-985d-b2db976b5107', '7c2124e0-3e11-4f5a-a6c9-76bc69193a55', '4a3fffd7-0027-4de8-ad66-4951390e7bf3', 'a83ccdf1-bfa7-43d3-8848-f0588a214ff5'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:34 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:17:34 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-465d67d0-6e22-44f6-95c2-7153e3785fcf-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Lock "cinder-465d67d0-6e22-44f6-95c2-7153e3785fcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-cb72e0fe-ce14-4adc-8d88-a22acd75855e" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-cb72e0fe-ce14-4adc-8d88-a22acd75855e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-465d67d0-6e22-44f6-95c2-7153e3785fcf" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-465d67d0-6e22-44f6-95c2-7153e3785fcf" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Deleting offline snapshot 465d67d0-6e22-44f6-95c2-7153e3785fcf of volume cb72e0fe-ce14-4adc-8d88-a22acd75855e {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:17:34 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] snapshot_file for this snap is: volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2ea5be-4776-450f-8bfa-53ceeebffc3d]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:35 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.720s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:35 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Deleted volume successfully.
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-250c7a1c-f7b3-4d15-a4b0-fa926267e8a0 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-2f78c051-49da-4dc0-9d4a-56d2e43c0d59-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:35 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf
Jul 04 00:17:35 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (5d2b15b4-686c-4d71-9bff-de31555cd1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f122d00-5949-4361-96b2-6aacd2268a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f122d00-5949-4361-96b2-6aacd2268a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1943795626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e32d472-4ef8-4c0b-8d20-1393e2e5f066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:35Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8c2a85-9ef0-40a1-86be-d10103990df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8c2a85-9ef0-40a1-86be-d10103990df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e9c6f9-e5f2-4556-acb7-d513bc7fc52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e9c6f9-e5f2-4556-acb7-d513bc7fc52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e32d472-4ef8-4c0b-8d20-1393e2e5f066', 'volume_name': 'volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b51927-6485-4d02-9cee-0be968814422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b51927-6485-4d02-9cee-0be968814422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (008eb3f8-146e-413b-b94c-99823040d155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:35 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Volume 4e32d472-4ef8-4c0b-8d20-1393e2e5f066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066', 'volume_size': 1}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1943795626',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e32d472-4ef8-4c0b-8d20-1393e2e5f066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:35Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Creating volume 4e32d472-4ef8-4c0b-8d20-1393e2e5f066 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:35 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:35 devstack sudo[106223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066 1073741824
Jul 04 00:17:35 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:35 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf" returned: 0 in 0.798s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[897b9bdb-3af5-446a-98b1-af8c7c3f169f]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:35 devstack sudo[106228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e
Jul 04 00:17:35 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:36 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066 1073741824" returned: 0 in 0.878s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:36 devstack sudo[106234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066
Jul 04 00:17:36 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:36 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e" returned: 0 in 0.839s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:36 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf
Jul 04 00:17:36 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:37 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066" returned: 0 in 0.626s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (008eb3f8-146e-413b-b94c-99823040d155) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82467e0-4aa6-4453-a2c8-b27ef79fd02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:37 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Volume volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066 (4e32d472-4ef8-4c0b-8d20-1393e2e5f066): created successfully
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82467e0-4aa6-4453-a2c8-b27ef79fd02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (5d2b15b4-686c-4d71-9bff-de31555cd1d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:37 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-691b87ad-7d8e-41c8-bddd-23b836d0d24a tempest-ProjectMemberTests-1651402342 None] Created volume successfully.
Jul 04 00:17:37 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf" returned: 0 in 0.777s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:37 devstack sudo[106245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf
Jul 04 00:17:37 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] Creating offline snapshot 67c72a5e-9308-4c4b-ac61-0e57e2e6742c of volume 4e32d472-4ef8-4c0b-8d20-1393e2e5f066 {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a289a590-dfe4-49e6-a3fe-7870ee2560e8]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:37 devstack sudo[106247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066
Jul 04 00:17:37 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:38 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e.465d67d0-6e22-44f6-95c2-7153e3785fcf" returned: 0 in 0.644s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-465d67d0-6e22-44f6-95c2-7153e3785fcf" released by "_delete_snapshot" :: held 3.152s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-cb72e0fe-ce14-4adc-8d88-a22acd75855e" released by "delete_snapshot" :: held 3.174s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:38 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Created reservations ['4915025a-6327-41d7-acff-e04c534a4c44', '8c14f564-769e-4dd9-a65e-5a9f643e145e', '9fd1174f-26b3-4277-918a-b110b5fec9d0', 'ed4e65b1-7c6d-4204-b9c9-8a4540e030b5'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Delete snapshot completed successfully.
Jul 04 00:17:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-05303639-5cd7-4894-8b7b-bc977e3b9577 tempest-ProjectReaderTests-762732484 None] Lock "cinder-465d67d0-6e22-44f6-95c2-7153e3785fcf-delete_snapshot" released by "delete_snapshot" :: held 3.300s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:38 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066" returned: 0 in 0.725s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:38 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c 1G
Jul 04 00:17:38 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-cb72e0fe-ce14-4adc-8d88-a22acd75855e-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Lock "cinder-cb72e0fe-ce14-4adc-8d88-a22acd75855e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:39 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c 1G" returned: 0 in 0.761s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:39 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c
Jul 04 00:17:39 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Acquiring lock "cinder-quobyte-cb72e0fe-ce14-4adc-8d88-a22acd75855e" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:39 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-cb72e0fe-ce14-4adc-8d88-a22acd75855e" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:39 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8ced7e-9f14-4f5b-9334-c08a668ef36b]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:39 devstack sudo[106261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e
Jul 04 00:17:39 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:39 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066 -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c" returned: 0 in 0.701s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:39 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c is being set with open permissions: ugo+rw
Jul 04 00:17:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:39 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c
Jul 04 00:17:39 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:40 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e" returned: 0 in 0.739s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:40 devstack sudo[106271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e
Jul 04 00:17:40 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:40 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c" returned: 0 in 0.624s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:40 devstack sudo[106274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.info
Jul 04 00:17:40 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:40 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-cb72e0fe-ce14-4adc-8d88-a22acd75855e" returned: 0 in 0.683s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Lock "cinder-quobyte-cb72e0fe-ce14-4adc-8d88-a22acd75855e" released by "delete_volume" :: held 1.488s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Created reservations ['5ca245a8-b374-40dd-974e-46a9722b7d09', '6cae573e-b682-4314-afa8-f3f17250e8f1', '1e80938a-f653-4195-b4ee-a54532373c6c', '4e137fcc-2f8e-4e9c-9b2b-caf96cf429fc'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:40 devstack sudo[106277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:17:40 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:41 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.info" returned: 0 in 0.651s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:41 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.info is being set with open permissions: ugo+rw
Jul 04 00:17:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:41 devstack sudo[106281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.info
Jul 04 00:17:41 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:41 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.697s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:41 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:41 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Deleted volume successfully.
Jul 04 00:17:41 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-0944ecce-f9b7-4269-ac07-6315dc5c7745 tempest-ProjectReaderTests-762732484 None] Lock "cinder-cb72e0fe-ce14-4adc-8d88-a22acd75855e-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:41 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.info" returned: 0 in 0.633s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.191s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:41 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-505bf934-532b-47cd-b0d2-afe8c2ed8264 tempest-ProjectMemberTests-1651402342 None] Create snapshot completed successfully
Jul 04 00:17:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-67c72a5e-9308-4c4b-ac61-0e57e2e6742c-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-67c72a5e-9308-4c4b-ac61-0e57e2e6742c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-4e32d472-4ef8-4c0b-8d20-1393e2e5f066" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-4e32d472-4ef8-4c0b-8d20-1393e2e5f066" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-67c72a5e-9308-4c4b-ac61-0e57e2e6742c" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:43 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-67c72a5e-9308-4c4b-ac61-0e57e2e6742c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Deleting offline snapshot 67c72a5e-9308-4c4b-ac61-0e57e2e6742c of volume 4e32d472-4ef8-4c0b-8d20-1393e2e5f066 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:17:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] snapshot_file for this snap is: volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:17:43 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a252ab-5519-4ff9-b281-5ed20b11b20c]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:43 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c
Jul 04 00:17:43 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:44 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c" returned: 0 in 0.772s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:17:44 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[690da03a-0b52-405c-bed6-0f32227a66c4]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:44 devstack sudo[106292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066
Jul 04 00:17:44 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:44 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066" returned: 0 in 0.775s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:44 devstack sudo[106298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c
Jul 04 00:17:44 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:45 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c" returned: 0 in 0.795s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:45 devstack sudo[106303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c
Jul 04 00:17:45 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:46 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066.67c72a5e-9308-4c4b-ac61-0e57e2e6742c" returned: 0 in 0.658s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-67c72a5e-9308-4c4b-ac61-0e57e2e6742c" released by "_delete_snapshot" :: held 3.114s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-4e32d472-4ef8-4c0b-8d20-1393e2e5f066" released by "delete_snapshot" :: held 3.143s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:46 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Created reservations ['043f4493-8e6f-4b7d-9ba7-636ee8e99e36', '639f7ce8-b065-44f4-88ef-4c1464e798c9', 'cdb69557-12ab-48c5-bdf4-4668389d72a0', '2f1e6cb7-b3de-4941-a716-733147d47b97'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:46 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Delete snapshot completed successfully.
Jul 04 00:17:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-8d3177dd-2fd6-42e3-b6d6-3982c135d966 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-67c72a5e-9308-4c4b-ac61-0e57e2e6742c-delete_snapshot" released by "delete_snapshot" :: held 3.292s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-4e32d472-4ef8-4c0b-8d20-1393e2e5f066-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Lock "cinder-4e32d472-4ef8-4c0b-8d20-1393e2e5f066-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-4e32d472-4ef8-4c0b-8d20-1393e2e5f066" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-4e32d472-4ef8-4c0b-8d20-1393e2e5f066" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:47 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cb5b7e-ddd9-4550-9e1f-b13c4acb26ff]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:47 devstack sudo[106306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066
Jul 04 00:17:47 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:48 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066" returned: 0 in 0.789s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:48 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066
Jul 04 00:17:48 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:48 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:48 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-4e32d472-4ef8-4c0b-8d20-1393e2e5f066" returned: 0 in 0.621s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:48 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-4e32d472-4ef8-4c0b-8d20-1393e2e5f066" released by "delete_volume" :: held 1.478s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:49 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Created reservations ['d6266790-2edb-4b1e-8c3f-1f9d727cedf9', '359a85ce-5a39-4a98-8f34-1db32976a6f0', 'a742e4b4-7c89-473d-8619-7dd7d3819fc3', '7d56ab72-54ab-4b23-89ba-f576105211bb'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:49 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:49 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:17:49 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:49 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:49 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.636s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:49 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:49 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Deleted volume successfully.
Jul 04 00:17:49 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a0aebea1-a742-4421-850c-e378d61b1b7f tempest-ProjectMemberTests-1651402342 None] Lock "cinder-4e32d472-4ef8-4c0b-8d20-1393e2e5f066-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (b6939695-db6e-4a16-bb34-e2b77cd4c2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ec7802-bd5a-4e87-925a-2525a3824378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08ec7802-bd5a-4e87-925a-2525a3824378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1170837366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173a272c-aaed-4855-a322-2e48572e672a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:50Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfce798-b7fa-4cfe-a348-6b8ea4e0cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdfce798-b7fa-4cfe-a348-6b8ea4e0cb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cb8b4b-bf03-4108-b324-d51f07ba57e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cb8b4b-bf03-4108-b324-d51f07ba57e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '173a272c-aaed-4855-a322-2e48572e672a', 'volume_name': 'volume-173a272c-aaed-4855-a322-2e48572e672a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea10fa00-6065-4b2b-86e8-80de9426e328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea10fa00-6065-4b2b-86e8-80de9426e328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf38e67-5881-42ce-9655-08b0296c0e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:50 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Volume 173a272c-aaed-4855-a322-2e48572e672a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-173a272c-aaed-4855-a322-2e48572e672a', 'volume_size': 1}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1170837366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173a272c-aaed-4855-a322-2e48572e672a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:50Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Creating volume 173a272c-aaed-4855-a322-2e48572e672a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:50 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:17:50 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:50 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a 1073741824
Jul 04 00:17:50 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:51 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a 1073741824" returned: 0 in 0.857s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:51 devstack sudo[106325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a
Jul 04 00:17:51 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:51 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a" returned: 0 in 0.667s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:51 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:51 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf38e67-5881-42ce-9655-08b0296c0e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173a272c-aaed-4855-a322-2e48572e672a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a02891-3f83-4577-8cac-8f5e188d9603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:51 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Volume volume-173a272c-aaed-4855-a322-2e48572e672a (173a272c-aaed-4855-a322-2e48572e672a): created successfully
Jul 04 00:17:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a02891-3f83-4577-8cac-8f5e188d9603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:51 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (b6939695-db6e-4a16-bb34-e2b77cd4c2bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:51 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cf3d1c34-9c43-4c82-bc90-2750e23bf44b tempest-ProjectMemberTests-1651402342 None] Created volume successfully.
Jul 04 00:17:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:52 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] Creating offline snapshot efdc9fe3-64c2-40e2-9236-898fd5ad0802 of volume 173a272c-aaed-4855-a322-2e48572e672a {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:17:52 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da2aefa-ccea-41d1-ba95-44dc193a942b]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:52 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:52 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a
Jul 04 00:17:52 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:53 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a" returned: 0 in 0.768s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:53 devstack sudo[106333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802 1G
Jul 04 00:17:53 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:53 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802 1G" returned: 0 in 0.762s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:53 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-173a272c-aaed-4855-a322-2e48572e672a -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:53 devstack sudo[106338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-173a272c-aaed-4855-a322-2e48572e672a -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802
Jul 04 00:17:53 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:54 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-173a272c-aaed-4855-a322-2e48572e672a -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802" returned: 0 in 0.701s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:54 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802 is being set with open permissions: ugo+rw
Jul 04 00:17:54 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:54 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802
Jul 04 00:17:54 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:55 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802" returned: 0 in 0.592s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:55 devstack sudo[106346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.info
Jul 04 00:17:55 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:55 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.info" returned: 0 in 0.630s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:55 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.info is being set with open permissions: ugo+rw
Jul 04 00:17:55 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:55 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.info
Jul 04 00:17:55 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:56 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.info" returned: 0 in 0.616s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:56 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.142s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:56 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d444bb61-d9cf-4f0a-a1e5-ab8c7e2cf146 tempest-ProjectMemberTests-1651402342 None] Create snapshot completed successfully
Jul 04 00:17:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-efdc9fe3-64c2-40e2-9236-898fd5ad0802-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Lock "cinder-efdc9fe3-64c2-40e2-9236-898fd5ad0802-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-173a272c-aaed-4855-a322-2e48572e672a" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-173a272c-aaed-4855-a322-2e48572e672a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-efdc9fe3-64c2-40e2-9236-898fd5ad0802" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:57 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-efdc9fe3-64c2-40e2-9236-898fd5ad0802" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Deleting offline snapshot efdc9fe3-64c2-40e2-9236-898fd5ad0802 of volume 173a272c-aaed-4855-a322-2e48572e672a {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:17:57 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] snapshot_file for this snap is: volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802 {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:17:57 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0044c9cd-5fbe-4ae0-8624-d69dc19c949e]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:57 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:57 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802
Jul 04 00:17:57 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:58 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802" returned: 0 in 0.718s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:58 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-173a272c-aaed-4855-a322-2e48572e672a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:17:58 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc26563-a1d7-42c4-87e4-4b3f44eff37a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:58 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:58 devstack sudo[106357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a
Jul 04 00:17:58 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:59 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a" returned: 0 in 0.724s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:59 devstack sudo[106362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802
Jul 04 00:17:59 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:59 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802" returned: 0 in 0.697s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:59 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:59 devstack sudo[106367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802
Jul 04 00:17:59 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:00 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a.efdc9fe3-64c2-40e2-9236-898fd5ad0802" returned: 0 in 0.633s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-efdc9fe3-64c2-40e2-9236-898fd5ad0802" released by "_delete_snapshot" :: held 2.857s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-173a272c-aaed-4855-a322-2e48572e672a" released by "delete_snapshot" :: held 2.878s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=98,cinder:INSERT=28,cinder:UPDATE=114,cinder:DELETE=10 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=112,cinder:SELECT=82,cinder:DELETE=10,cinder:INSERT=34 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Created reservations ['83219134-b6da-4987-8d26-d78b7ff95985', '5b7d58f4-2e4e-47c3-9ed9-835f1e6a5122', 'fccad791-c2ab-44fc-b505-80de4ba68832', '8132f25b-2662-4ce0-b993-8a9eaf1a5a91'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:00 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Delete snapshot completed successfully.
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6c75535-2bb9-4052-be13-5e09dfb68b9e tempest-ProjectMemberTests-1651402342 None] Lock "cinder-efdc9fe3-64c2-40e2-9236-898fd5ad0802-delete_snapshot" released by "delete_snapshot" :: held 3.019s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-173a272c-aaed-4855-a322-2e48572e672a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-173a272c-aaed-4855-a322-2e48572e672a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-173a272c-aaed-4855-a322-2e48572e672a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-173a272c-aaed-4855-a322-2e48572e672a" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29bbfcd-cca0-4c37-909f-6b6525363d7b]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:00 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:00 devstack sudo[106370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a
Jul 04 00:18:00 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:01 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a" returned: 0 in 0.727s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:01 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:01 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a
Jul 04 00:18:01 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:02 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-173a272c-aaed-4855-a322-2e48572e672a" returned: 0 in 0.602s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-173a272c-aaed-4855-a322-2e48572e672a" released by "delete_volume" :: held 1.382s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:02 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Created reservations ['cf7d94c3-c602-46e6-bd66-cec969ba4afb', '563989db-2b05-4385-917d-5e44ba673c23', 'db905df4-df1f-4cdd-925b-0e2b37ff7f35', '6951f005-7ac1-4caa-b053-9ff3bcbc5e81'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:02 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:02 devstack sudo[106379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:18:02 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:02 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:02 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.632s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:02 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:02 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Deleted volume successfully.
Jul 04 00:18:02 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-68faa55e-4979-4261-8535-2ff2673a1390 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-173a272c-aaed-4855-a322-2e48572e672a-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (5fa1dc91-08a4-42cd-b480-6f56a6f26f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9668b6f4-b9a8-47b8-b8f2-2fb319f00b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9668b6f4-b9a8-47b8-b8f2-2fb319f00b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284750555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba71a0ba-574e-4676-bf80-cebef9fc05bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:03Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc34eb5-c5d7-438a-bd60-423b54c34160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc34eb5-c5d7-438a-bd60-423b54c34160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6973fa70-0aa0-4cc6-96ac-30e171eef008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6973fa70-0aa0-4cc6-96ac-30e171eef008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba71a0ba-574e-4676-bf80-cebef9fc05bf', 'volume_name': 'volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0145e7-593c-40ce-99ec-4b6f5fff4aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca0145e7-593c-40ce-99ec-4b6f5fff4aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7fce25-0cc6-419e-a876-c78e79abc6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:03 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Volume ba71a0ba-574e-4676-bf80-cebef9fc05bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf', 'volume_size': 1}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-284750555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba71a0ba-574e-4676-bf80-cebef9fc05bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='599df25efaa94d97bf96fffa09c5fa5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:03Z,use_quota=True,user_id='2843b3f5a5004a25905c48447b195da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Creating volume ba71a0ba-574e-4676-bf80-cebef9fc05bf {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:18:03 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:18:03 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:03 devstack sudo[106383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf 1073741824
Jul 04 00:18:03 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:04 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf 1073741824" returned: 0 in 0.750s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:04 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf
Jul 04 00:18:04 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:04 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf" returned: 0 in 0.655s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:04 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:18:04 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7fce25-0cc6-419e-a876-c78e79abc6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd8d959-390a-4371-9624-832836e12c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:04 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Volume volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf (ba71a0ba-574e-4676-bf80-cebef9fc05bf): created successfully
Jul 04 00:18:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd8d959-390a-4371-9624-832836e12c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:04 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Flow 'volume_create_manager' (5fa1dc91-08a4-42cd-b480-6f56a6f26f55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:04 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-cb67e61a-1aef-4b4c-8c84-5f46ea4ef4b1 tempest-ProjectMemberTests-1651402342 None] Created volume successfully.
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:05 devstack sudo[106392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:18:05 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] Creating offline snapshot b734db84-7927-41e1-ba70-e82258d7f88e of volume ba71a0ba-574e-4676-bf80-cebef9fc05bf {{(pid=86648) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f08a8b-1699-4430-9b4b-73f11af75300]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:05 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf
Jul 04 00:18:05 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:05 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.688s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG oslo_service.periodic_task [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] Running periodic task VolumeManager._thread_info {{(pid=86648) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread count: 28 {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:18:05 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-a6e4ff88-192d-4702-9c87-629e22b088f1 None None] thread info: [<_MainThread(MainThread, started 130898585686144)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130898476319744)>, <Thread(Thread-3 (stat_writer), started daemon 130898473582528)>, <Thread(Rabbit-heartbeat, started daemon 130898474015104)>, <Thread(Thread-5 (_runner), started daemon 130898474150336)>, <Thread(Thread-7 (_runner), started daemon 130898474216704)>, <Thread(fd_logger, started daemon 130898470824768)>, <Thread(privsep_reader, started daemon 130898470012096)>, <Thread(tpool_thread_0, started daemon 130898462611136)>, <Thread(tpool_thread_1, started daemon 130898454202048)>, <Thread(tpool_thread_2, started daemon 130898445792960)>, <Thread(tpool_thread_3, started daemon 130898437383872)>, <Thread(tpool_thread_4, started daemon 130898428974784)>, <Thread(tpool_thread_5, started daemon 130898420565696)>, <Thread(tpool_thread_6, started daemon 130898412156608)>, <Thread(tpool_thread_7, started daemon 130898403747520)>, <Thread(tpool_thread_8, started daemon 130898395338432)>, <Thread(tpool_thread_9, started daemon 130898386929344)>, <Thread(tpool_thread_10, started daemon 130898378520256)>, <Thread(tpool_thread_11, started daemon 130898370111168)>, <Thread(tpool_thread_12, started daemon 130898361702080)>, <Thread(tpool_thread_13, started daemon 130898353292992)>, <Thread(tpool_thread_14, started daemon 130898344883904)>, <Thread(tpool_thread_15, started daemon 130898336474816)>, <Thread(tpool_thread_16, started daemon 130898328065728)>, <Thread(tpool_thread_17, started daemon 130898319656640)>, <Thread(tpool_thread_18, started daemon 130898311247552)>, <Thread(tpool_thread_19, started daemon 130898302838464)>] {{(pid=86648) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:18:06 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf" returned: 0 in 0.789s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:06 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e 1G {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:06 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e 1G
Jul 04 00:18:06 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:07 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e 1G" returned: 0 in 0.751s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:07 devstack sudo[106407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e
Jul 04 00:18:07 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:07 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf -F qcow2 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e" returned: 0 in 0.643s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:07 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e is being set with open permissions: ugo+rw
Jul 04 00:18:07 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:07 devstack sudo[106412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e
Jul 04 00:18:07 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:08 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e" returned: 0 in 0.605s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:08 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:08 devstack sudo[106415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.info
Jul 04 00:18:08 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:09 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.info" returned: 0 in 0.636s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:09 devstack cinder-volume[86648]: WARNING cinder.volume.drivers.remotefs [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.info is being set with open permissions: ugo+rw
Jul 04 00:18:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.info {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:09 devstack sudo[106418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.info
Jul 04 00:18:09 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:09 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.info" returned: 0 in 0.648s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:09 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.145s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:09 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-662a024e-6988-4f08-a188-6ee5cdfd9776 tempest-ProjectMemberTests-1651402342 None] Create snapshot completed successfully
Jul 04 00:18:10 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-b734db84-7927-41e1-ba70-e82258d7f88e-delete_snapshot" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-b734db84-7927-41e1-ba70-e82258d7f88e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-ba71a0ba-574e-4676-bf80-cebef9fc05bf" by "delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-ba71a0ba-574e-4676-bf80-cebef9fc05bf" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-b734db84-7927-41e1-ba70-e82258d7f88e" by "_delete_snapshot" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-b734db84-7927-41e1-ba70-e82258d7f88e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Deleting offline snapshot b734db84-7927-41e1-ba70-e82258d7f88e of volume ba71a0ba-574e-4676-bf80-cebef9fc05bf {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] snapshot_file for this snap is: volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e {{(pid=86648) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a32db5b-ab52-4f46-9662-b243a2157f68]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:11 devstack sudo[106421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e
Jul 04 00:18:11 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:11 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e" returned: 0 in 0.730s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86648) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[864218e8-8b26-4fef-b447-9207c1255293]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:11 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:11 devstack sudo[106427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf
Jul 04 00:18:11 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:12 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf" returned: 0 in 0.724s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:12 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:12 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e
Jul 04 00:18:12 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:13 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e" returned: 0 in 0.680s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:13 devstack sudo[106437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e
Jul 04 00:18:13 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:13 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:13 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf.b734db84-7927-41e1-ba70-e82258d7f88e" returned: 0 in 0.606s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-b734db84-7927-41e1-ba70-e82258d7f88e" released by "_delete_snapshot" :: held 2.829s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-ba71a0ba-574e-4676-bf80-cebef9fc05bf" released by "delete_snapshot" :: held 2.853s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:13 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Created reservations ['73acf74f-31ab-4bdf-a52c-5cd0bb0d4da0', '8f63c034-ea7f-405d-a824-32192fdd1a3f', 'df8ea744-e604-48e2-8def-d1569b242aa9', 'de8ec486-c566-4542-a5d2-4c7c4c397766'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:13 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Delete snapshot completed successfully.
Jul 04 00:18:13 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-a7130334-0ff5-451d-a499-29bd0e26c904 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-b734db84-7927-41e1-ba70-e82258d7f88e-delete_snapshot" released by "delete_snapshot" :: held 2.977s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-ba71a0ba-574e-4676-bf80-cebef9fc05bf-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-ba71a0ba-574e-4676-bf80-cebef9fc05bf-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "cinder-quobyte-ba71a0ba-574e-4676-bf80-cebef9fc05bf" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:14 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-ba71a0ba-574e-4676-bf80-cebef9fc05bf" acquired by "delete_volume" :: waited 0.013s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:14 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b49294-1faa-436d-a0dd-716a3d530522]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:14 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:14 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf
Jul 04 00:18:14 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:15 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf" returned: 0 in 0.745s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:15 devstack sudo[106445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf
Jul 04 00:18:15 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:15 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-ba71a0ba-574e-4676-bf80-cebef9fc05bf" returned: 0 in 0.617s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:15 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-quobyte-ba71a0ba-574e-4676-bf80-cebef9fc05bf" released by "delete_volume" :: held 1.414s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:15 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Created reservations ['de64b5fb-fed9-474b-889a-1abb41534acf', '1f199467-d5ae-425b-915c-ed6a62486e92', '51be05f7-361d-4cd2-9f12-64c230acc91f', 'aeabf78b-401d-4442-ab84-9d69f73b5209'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:15 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:15 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:15 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:18:15 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:16 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:16 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.624s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:16 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:16 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Deleted volume successfully.
Jul 04 00:18:16 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-9fc6e03e-614c-48b1-9747-0378f9f69479 tempest-ProjectMemberTests-1651402342 None] Lock "cinder-ba71a0ba-574e-4676-bf80-cebef9fc05bf-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:25 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:INSERT=8,cinder:UPDATE=32,cinder:SELECT=23,cinder:DELETE=2 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:18:26 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=22,cinder:INSERT=10,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Flow 'volume_create_manager' (371c1722-d153-4582-8a42-b1524e4042fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb25ee20-3a15-48d3-bfdf-e5f96a2ec90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb25ee20-3a15-48d3-bfdf-e5f96a2ec90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383311103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5c446a-d423-4fcb-b9c9-32896ca0319a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acc7d66870c4b9ca097cc4d29b424af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:29Z,use_quota=True,user_id='42b916a613934905874e02f9ac95314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf9bd26-5d16-46f5-9cd6-fe86f85dec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf9bd26-5d16-46f5-9cd6-fe86f85dec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56ff8ad-2126-41e5-910e-27374070755f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56ff8ad-2126-41e5-910e-27374070755f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a5c446a-d423-4fcb-b9c9-32896ca0319a', 'volume_name': 'volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d432a1c-845e-443a-90d3-046ebf958513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d432a1c-845e-443a-90d3-046ebf958513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7408ad3-0093-430f-a770-43f0dcd8178d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:28 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Volume 8a5c446a-d423-4fcb-b9c9-32896ca0319a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a', 'volume_size': 1}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383311103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5c446a-d423-4fcb-b9c9-32896ca0319a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acc7d66870c4b9ca097cc4d29b424af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:29Z,use_quota=True,user_id='42b916a613934905874e02f9ac95314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Creating volume 8a5c446a-d423-4fcb-b9c9-32896ca0319a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:18:28 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:18:28 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:28 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a 1073741824
Jul 04 00:18:28 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:29 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a 1073741824" returned: 0 in 0.926s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:29 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:29 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a
Jul 04 00:18:29 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:30 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a" returned: 0 in 0.646s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:30 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:18:30 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7408ad3-0093-430f-a770-43f0dcd8178d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5941e2-828a-49c9-a4e4-7783d243e5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:30 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Volume volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a (8a5c446a-d423-4fcb-b9c9-32896ca0319a): created successfully
Jul 04 00:18:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5941e2-828a-49c9-a4e4-7783d243e5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:30 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Flow 'volume_create_manager' (371c1722-d153-4582-8a42-b1524e4042fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:30 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-14b4283a-254a-4711-9d46-f254f129d223 tempest-ProjectReaderTests-2008262025 None] Created volume successfully.
Jul 04 00:18:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "cinder-8a5c446a-d423-4fcb-b9c9-32896ca0319a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-8a5c446a-d423-4fcb-b9c9-32896ca0319a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "cinder-quobyte-8a5c446a-d423-4fcb-b9c9-32896ca0319a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:31 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-quobyte-8a5c446a-d423-4fcb-b9c9-32896ca0319a" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:31 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cacd0a3-39e2-4db2-8412-92e56d1fb326]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:31 devstack sudo[106505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a
Jul 04 00:18:31 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:31 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a" returned: 0 in 0.746s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:31 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:31 devstack sudo[106510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a
Jul 04 00:18:31 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:32 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-8a5c446a-d423-4fcb-b9c9-32896ca0319a" returned: 0 in 0.640s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:32 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-quobyte-8a5c446a-d423-4fcb-b9c9-32896ca0319a" released by "delete_volume" :: held 1.428s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:32 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Created reservations ['1a9b0ece-86ea-4633-9a4f-c9dbf59dd10c', '82b5341d-34f7-427a-92e1-2c1b6eb4ac89', 'f87743c2-7ac9-42d0-bca8-8ee3162f8048', '87eef736-92ad-45af-befe-bd477e76643d'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:32 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:32 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:32 devstack sudo[106513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:18:32 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:33 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.655s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:33 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Deleted volume successfully.
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-b0519125-0187-4015-8ccb-18721e297ca7 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-8a5c446a-d423-4fcb-b9c9-32896ca0319a-delete_volume" released by "delete_volume" :: held 2.298s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Flow 'volume_create_manager' (5bb750a5-1a0d-48f4-8f9a-79f0d1eccb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b663316-a678-4d3c-8ccc-506d0dd5bba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b663316-a678-4d3c-8ccc-506d0dd5bba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303694852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a4e2ca-dae9-45dc-a9ee-1659f64e791a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acc7d66870c4b9ca097cc4d29b424af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:34Z,use_quota=True,user_id='42b916a613934905874e02f9ac95314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7888f04d-f65d-424d-8260-27bfee5e702a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7888f04d-f65d-424d-8260-27bfee5e702a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41a7d24-3991-4e40-9ed5-104eb6b68003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d41a7d24-3991-4e40-9ed5-104eb6b68003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15a4e2ca-dae9-45dc-a9ee-1659f64e791a', 'volume_name': 'volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec41fc48-8315-4a01-bfdd-520a950ac20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec41fc48-8315-4a01-bfdd-520a950ac20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297f73a9-03e7-4ec6-b4f1-b3e0781df185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:33 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Volume 15a4e2ca-dae9-45dc-a9ee-1659f64e791a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a', 'volume_size': 1}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1303694852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15a4e2ca-dae9-45dc-a9ee-1659f64e791a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acc7d66870c4b9ca097cc4d29b424af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:34Z,use_quota=True,user_id='42b916a613934905874e02f9ac95314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Creating volume 15a4e2ca-dae9-45dc-a9ee-1659f64e791a {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:18:33 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:18:33 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:33 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a 1073741824
Jul 04 00:18:33 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:34 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a 1073741824" returned: 0 in 0.875s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:34 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:34 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a
Jul 04 00:18:34 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:35 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a" returned: 0 in 0.731s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (297f73a9-03e7-4ec6-b4f1-b3e0781df185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82499de0-243d-4cb6-b848-29b2e201b965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:35 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Volume volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a (15a4e2ca-dae9-45dc-a9ee-1659f64e791a): created successfully
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82499de0-243d-4cb6-b848-29b2e201b965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Flow 'volume_create_manager' (5bb750a5-1a0d-48f4-8f9a-79f0d1eccb6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:35 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0d596986-9b4e-499e-a025-9f5e24b23cb1 tempest-ProjectReaderTests-2008262025 None] Created volume successfully.
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "cinder-15a4e2ca-dae9-45dc-a9ee-1659f64e791a-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-15a4e2ca-dae9-45dc-a9ee-1659f64e791a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "cinder-quobyte-15a4e2ca-dae9-45dc-a9ee-1659f64e791a" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-quobyte-15a4e2ca-dae9-45dc-a9ee-1659f64e791a" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09cf891-9fbf-43e0-8182-d01ef7acffbb]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:35 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:36 devstack sudo[106525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a
Jul 04 00:18:36 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:36 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a" returned: 0 in 0.754s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:36 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:36 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a
Jul 04 00:18:36 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:37 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-15a4e2ca-dae9-45dc-a9ee-1659f64e791a" returned: 0 in 0.608s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:37 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-quobyte-15a4e2ca-dae9-45dc-a9ee-1659f64e791a" released by "delete_volume" :: held 1.403s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:37 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Created reservations ['ccfd36af-1d41-4f26-899f-87fa92239821', '53feb7e7-5b8a-44fa-8e9b-7aa5c104ace8', '5f4bbcb1-ff02-4d73-bdc2-e9f7f9521282', 'e8b4eb55-b80f-458b-a7f6-3d9005459552'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:37 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:37 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:37 devstack sudo[106533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:18:37 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:38 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.722s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:38 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Deleted volume successfully.
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-3c8ad7b4-7f11-40b4-8388-b924b91393f7 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-15a4e2ca-dae9-45dc-a9ee-1659f64e791a-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Flow 'volume_create_manager' (f2633f96-632b-4499-a0e7-13d82dbed5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0dd5aaf-868c-4e98-8659-0bc15e1ce6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0dd5aaf-868c-4e98-8659-0bc15e1ce6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553215414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7323ccfe-4cde-4356-9671-7acf075f7022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acc7d66870c4b9ca097cc4d29b424af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:38Z,use_quota=True,user_id='42b916a613934905874e02f9ac95314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e55b92-8191-4c43-8e21-dacb72e39564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e55b92-8191-4c43-8e21-dacb72e39564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bd9dc9-3b5d-45d9-a8a4-8f52694c751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90bd9dc9-3b5d-45d9-a8a4-8f52694c751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7323ccfe-4cde-4356-9671-7acf075f7022', 'volume_name': 'volume-7323ccfe-4cde-4356-9671-7acf075f7022', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a88ba87-8ef7-4c2b-8844-df1e36102813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a88ba87-8ef7-4c2b-8844-df1e36102813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c256e5-e1f5-4d6d-bd1c-b210689c6ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:38 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Volume 7323ccfe-4cde-4356-9671-7acf075f7022: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7323ccfe-4cde-4356-9671-7acf075f7022', 'volume_size': 1}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553215414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7323ccfe-4cde-4356-9671-7acf075f7022,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acc7d66870c4b9ca097cc4d29b424af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:38Z,use_quota=True,user_id='42b916a613934905874e02f9ac95314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Creating volume 7323ccfe-4cde-4356-9671-7acf075f7022 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:18:38 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:18:38 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7323ccfe-4cde-4356-9671-7acf075f7022 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:38 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7323ccfe-4cde-4356-9671-7acf075f7022 1073741824
Jul 04 00:18:38 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:39 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7323ccfe-4cde-4356-9671-7acf075f7022 1073741824" returned: 0 in 0.891s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:39 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7323ccfe-4cde-4356-9671-7acf075f7022 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:39 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7323ccfe-4cde-4356-9671-7acf075f7022
Jul 04 00:18:39 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:40 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7323ccfe-4cde-4356-9671-7acf075f7022" returned: 0 in 0.633s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c256e5-e1f5-4d6d-bd1c-b210689c6ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7323ccfe-4cde-4356-9671-7acf075f7022', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e7a2bb-d624-4191-8e98-677227a92a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:40 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Volume volume-7323ccfe-4cde-4356-9671-7acf075f7022 (7323ccfe-4cde-4356-9671-7acf075f7022): created successfully
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5e7a2bb-d624-4191-8e98-677227a92a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Flow 'volume_create_manager' (f2633f96-632b-4499-a0e7-13d82dbed5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:40 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-0ed03c18-0794-4330-90bd-b28779676519 tempest-ProjectReaderTests-2008262025 None] Created volume successfully.
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "cinder-7323ccfe-4cde-4356-9671-7acf075f7022-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-7323ccfe-4cde-4356-9671-7acf075f7022-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "cinder-quobyte-7323ccfe-4cde-4356-9671-7acf075f7022" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-quobyte-7323ccfe-4cde-4356-9671-7acf075f7022" acquired by "delete_volume" :: waited 0.019s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3042a129-6707-4b04-b520-852a680f37e4]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:40 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7323ccfe-4cde-4356-9671-7acf075f7022 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:40 devstack sudo[106545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7323ccfe-4cde-4356-9671-7acf075f7022
Jul 04 00:18:40 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:41 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7323ccfe-4cde-4356-9671-7acf075f7022" returned: 0 in 0.715s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:41 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7323ccfe-4cde-4356-9671-7acf075f7022 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:41 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7323ccfe-4cde-4356-9671-7acf075f7022
Jul 04 00:18:41 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:42 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-7323ccfe-4cde-4356-9671-7acf075f7022" returned: 0 in 0.600s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-quobyte-7323ccfe-4cde-4356-9671-7acf075f7022" released by "delete_volume" :: held 1.351s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:42 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Created reservations ['f69f815e-0348-4827-a385-e6e8f2e95dd1', '13051c35-2b4f-4612-9b7b-9489665225fb', 'a1370260-19bc-4460-be68-7e7a6d54f54a', '2b56b698-0172-4e79-bf1d-c4193eddaab9'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:42 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:42 devstack sudo[106554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:18:42 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:42 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:42 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.639s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:42 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:42 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Deleted volume successfully.
Jul 04 00:18:42 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-d6e768db-925b-4606-ba5b-1ab8cf7ee3d2 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-7323ccfe-4cde-4356-9671-7acf075f7022-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.flows.manager.create_volume [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86648) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Flow 'volume_create_manager' (f42c2b4b-caf7-4aff-ad5f-707b57818e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7148f43c-0305-4d4d-8e5c-ed6910d2bb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7148f43c-0305-4d4d-8e5c-ed6910d2bb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1969114564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a80512-f761-4433-b73e-7fccbdac1549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acc7d66870c4b9ca097cc4d29b424af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:43Z,use_quota=True,user_id='42b916a613934905874e02f9ac95314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b3c610-160a-4824-8003-83079f99764e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b3c610-160a-4824-8003-83079f99764e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421337fb-eb4a-4bd7-b3ff-9b82b4252456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421337fb-eb4a-4bd7-b3ff-9b82b4252456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2a80512-f761-4433-b73e-7fccbdac1549', 'volume_name': 'volume-c2a80512-f761-4433-b73e-7fccbdac1549', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7032ae-7fd8-4ff3-be88-063bfacbab6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7032ae-7fd8-4ff3-be88-063bfacbab6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3a78ce-5835-4cb8-9882-42e217db2053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:43 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Volume c2a80512-f761-4433-b73e-7fccbdac1549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2a80512-f761-4433-b73e-7fccbdac1549', 'volume_size': 1}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x770d2d8bb6b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1969114564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2a80512-f761-4433-b73e-7fccbdac1549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acc7d66870c4b9ca097cc4d29b424af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:43Z,use_quota=True,user_id='42b916a613934905874e02f9ac95314c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0a9bf7a9-5f2d-4bd3-83cf-b304643902ab),volume_type_id=0a9bf7a9-5f2d-4bd3-83cf-b304643902ab)}" {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.remotefs [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Creating volume c2a80512-f761-4433-b73e-7fccbdac1549 {{(pid=86648) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Selected osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1 as target Quobyte volume. {{(pid=86648) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:18:43 devstack cinder-volume[86648]: INFO cinder.volume.drivers.remotefs [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] casted to osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1
Jul 04 00:18:43 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c2a80512-f761-4433-b73e-7fccbdac1549 1073741824 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:43 devstack sudo[106557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c2a80512-f761-4433-b73e-7fccbdac1549 1073741824
Jul 04 00:18:43 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:44 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c2a80512-f761-4433-b73e-7fccbdac1549 1073741824" returned: 0 in 0.752s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c2a80512-f761-4433-b73e-7fccbdac1549 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:44 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c2a80512-f761-4433-b73e-7fccbdac1549
Jul 04 00:18:44 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:44 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c2a80512-f761-4433-b73e-7fccbdac1549" returned: 0 in 0.647s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:44 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'} {{(pid=86648) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:18:44 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd3a78ce-5835-4cb8-9882-42e217db2053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2a80512-f761-4433-b73e-7fccbdac1549', 'volume_size': 1}' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9f3844-d7b5-472a-bfed-c393e1934230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:44 devstack cinder-volume[86648]: INFO cinder.volume.flows.manager.create_volume [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Volume volume-c2a80512-f761-4433-b73e-7fccbdac1549 (c2a80512-f761-4433-b73e-7fccbdac1549): created successfully
Jul 04 00:18:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9f3844-d7b5-472a-bfed-c393e1934230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86648) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:44 devstack cinder-volume[86648]: DEBUG cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Flow 'volume_create_manager' (f42c2b4b-caf7-4aff-ad5f-707b57818e77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86648) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:44 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-e726462d-7389-4af6-a741-3119652cdf7f tempest-ProjectReaderTests-2008262025 None] Created volume successfully.
Jul 04 00:18:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "cinder-c2a80512-f761-4433-b73e-7fccbdac1549-delete_volume" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-c2a80512-f761-4433-b73e-7fccbdac1549-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "cinder-quobyte-c2a80512-f761-4433-b73e-7fccbdac1549" by "delete_volume" {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:45 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-quobyte-c2a80512-f761-4433-b73e-7fccbdac1549" acquired by "delete_volume" :: waited 0.015s {{(pid=86648) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:45 devstack cinder-volume[86648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab80504-ddf9-4e2d-83e7-e3270374053a]: (4, 'qcow2') {{(pid=87598) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:45 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c2a80512-f761-4433-b73e-7fccbdac1549 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:45 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c2a80512-f761-4433-b73e-7fccbdac1549
Jul 04 00:18:45 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:46 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c2a80512-f761-4433-b73e-7fccbdac1549" returned: 0 in 0.707s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c2a80512-f761-4433-b73e-7fccbdac1549 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:46 devstack sudo[106571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c2a80512-f761-4433-b73e-7fccbdac1549
Jul 04 00:18:46 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:46 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781/volume-c2a80512-f761-4433-b73e-7fccbdac1549" returned: 0 in 0.606s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:46 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-quobyte-c2a80512-f761-4433-b73e-7fccbdac1549" released by "delete_volume" :: held 1.353s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:46 devstack cinder-volume[86648]: DEBUG cinder.quota [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Created reservations ['bd241c4e-27c7-4221-aa81-69be04e141d2', 'aa99eea1-568c-4cfa-a149-23d18db3e67d', '96e15fa1-0a42-487e-be34-b60c2d8d762b', '51e6ee86-d2d0-4e8b-b53b-6894d9dcbaee'] {{(pid=86648) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1': None} {{(pid=86648) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:46 devstack cinder-volume[86648]: DEBUG cinder.volume.drivers.quobyte [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4dffc25e-59c1-46c8-aa45-d6ef912cb7e1'] {{(pid=86648) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.lockutils [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86648) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:46 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781 {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:46 devstack sudo[106574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781
Jul 04 00:18:46 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:47 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:47 devstack cinder-volume[86648]: DEBUG oslo_concurrency.processutils [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/44bb29d5ab84c95ac060ffa3dbe47781" returned: 0 in 0.592s {{(pid=86648) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:47 devstack cinder-volume[86648]: DEBUG cinder.manager [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Notifying Schedulers of capabilities ... {{(pid=86648) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:47 devstack cinder-volume[86648]: INFO cinder.volume.manager [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Deleted volume successfully.
Jul 04 00:18:47 devstack cinder-volume[86648]: DEBUG cinder.coordination [None req-5ecc7189-c65f-4f1a-b19f-5314627accd9 tempest-ProjectReaderTests-2008262025 None] Lock "cinder-c2a80512-f761-4433-b73e-7fccbdac1549-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=86648) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:56 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:SELECT=21,cinder:UPDATE=41,cinder:DELETE=7,cinder:INSERT=13 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:18:57 devstack cinder-volume[86648]: DEBUG dbcounter [-] [86648] Writing DB stats cinder:UPDATE=47,cinder:SELECT=35,cinder:INSERT=7,cinder:DELETE=1 {{(pid=86648) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}